Nov 21 14:13:20 user nova-compute[74882]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74882) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74882) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74882) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 21 14:13:20 user nova-compute[74882]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:13:20 user nova-compute[74882]: INFO nova.virt.driver [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 21 14:13:20 user nova-compute[74882]: INFO nova.compute.provider_config [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Acquiring lock "singleton_lock" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Acquired lock "singleton_lock" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Releasing lock "singleton_lock" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Full set of CONF: {{(pid=74882) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ******************************************************************************** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Configuration options gathered from: {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ================================================================================ {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] allow_resize_to_same_host      = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] arq_binding_timeout            = 300 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] backdoor_port                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] backdoor_socket                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] block_device_allocate_retries  = 300 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] block_device_allocate_retries_interval = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cert                           = self.pem {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute_monitors               = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] config_dir                     = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] config_drive_format            = iso9660 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] config_source                  = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] console_host                   = user {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] control_exchange               = nova {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cpu_allocation_ratio           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] daemon                         = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] debug                          = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] default_access_ip_network_name = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] default_availability_zone      = nova {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] default_ephemeral_format       = ext4 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] default_green_pool_size        = 1000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] default_schedule_zone          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] disk_allocation_ratio          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] enable_new_services            = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] enabled_ssl_apis               = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] flat_injected                  = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] force_config_drive             = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] force_raw_images               = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] graceful_shutdown_timeout      = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] heal_instance_info_cache_interval = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] host                           = user {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instance_build_timeout         = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instance_delete_interval       = 300 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instance_name_template         = instance-%08x {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instance_usage_audit           = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instance_usage_audit_period    = month {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] internal_service_availability_zone = internal {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] key                            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] live_migration_retry_count     = 30 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_config_append              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_dir                        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_file                       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_options                    = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_rotate_interval            = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_rotate_interval_type       = days {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] log_rotation_type              = none {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] long_rpc_timeout               = 1800 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] max_concurrent_builds          = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] max_concurrent_live_migrations = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] max_concurrent_snapshots       = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] max_local_block_devices        = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] max_logfile_count              = 30 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] max_logfile_size_mb            = 200 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] maximum_instance_delete_attempts = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] metadata_listen                = 0.0.0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] metadata_listen_port           = 8775 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] metadata_workers               = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] migrate_max_retries            = -1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] mkisofs_cmd                    = genisoimage {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] my_ip                          = 10.0.0.210 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] network_allocate_retries       = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] osapi_compute_listen_port      = 8774 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] osapi_compute_unique_server_name_scope =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] osapi_compute_workers          = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] password_length                = 12 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] periodic_enable                = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] periodic_fuzzy_delay           = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] pointer_model                  = ps2mouse {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] preallocate_images             = none {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] publish_errors                 = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] pybasedir                      = /opt/stack/nova {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ram_allocation_ratio           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rate_limit_burst               = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rate_limit_except_level        = CRITICAL {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rate_limit_interval            = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] reboot_timeout                 = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] reclaim_instance_interval      = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] record                         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] reimage_timeout_per_gb         = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] report_interval                = 120 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rescue_timeout                 = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] reserved_host_cpus             = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] reserved_host_disk_mb          = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] reserved_host_memory_mb        = 512 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] reserved_huge_pages            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] resize_confirm_window          = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] resize_fs_using_block_device   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] resume_guests_state_on_host_boot = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rpc_response_timeout           = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] run_external_periodic_tasks    = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] running_deleted_instance_action = reap {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] running_deleted_instance_timeout = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler_instance_sync_interval = 120 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_down_time              = 720 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] servicegroup_driver            = db {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] shelved_offload_time           = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] shelved_poll_interval          = 3600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] shutdown_timeout               = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] source_is_ipv6                 = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ssl_only                       = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] state_path                     = /opt/stack/data/nova {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] sync_power_state_interval      = 600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] sync_power_state_pool_size     = 1000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] syslog_log_facility            = LOG_USER {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] tempdir                        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] timeout_nbd                    = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] transport_url                  = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] update_resources_interval      = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] use_cow_images                 = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] use_eventlog                   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] use_journal                    = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] use_json                       = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] use_rootwrap_daemon            = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] use_stderr                     = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] use_syslog                     = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vcpu_pin_set                   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plugging_is_fatal          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plugging_timeout           = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] virt_mkfs                      = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] volume_usage_poll_interval     = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] watch_log_file                 = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] web                            = /usr/share/spice-html5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_concurrency.disable_process_locking = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.auth_strategy              = keystone {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.compute_link_prefix        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.dhcp_domain                = novalocal {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.enable_instance_password   = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.glance_link_prefix         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.instance_list_per_project_cells = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.list_records_by_skipping_down_cells = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.local_metadata_per_cell    = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.max_limit                  = 1000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.metadata_cache_expiration  = 15 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.neutron_default_tenant_id  = default {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.use_forwarded_for          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.use_neutron_default_nets   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.vendordata_dynamic_targets = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.vendordata_jsonfile_path   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.backend_argument         = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.config_prefix            = cache.oslo {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.dead_timeout             = 60.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.debug_cache_backend      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.enable_retry_client      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.enable_socket_keepalive  = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.enabled                  = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.expiration_time          = 600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.hashclient_retry_attempts = 2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_dead_retry      = 300 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_password        =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_sasl_enabled    = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.memcache_username        =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.proxies                  = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.retry_attempts           = 2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.retry_delay              = 0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.socket_keepalive_count   = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.socket_keepalive_idle    = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.socket_keepalive_interval = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.tls_allowed_ciphers      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.tls_cafile               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.tls_certfile             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.tls_enabled              = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cache.tls_keyfile              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.auth_section            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.auth_type               = password {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.cafile                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.certfile                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.collect_timing          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.cross_az_attach         = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.debug                   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.endpoint_template       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.http_retries            = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.insecure                = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.keyfile                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.os_region_name          = RegionOne {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.split_loggers           = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cinder.timeout                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.cpu_dedicated_set      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.cpu_shared_set         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.image_type_exclude_list = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.resource_provider_association_refresh = 300 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.shutdown_retry_interval = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] conductor.workers              = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] console.allowed_origins        = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] console.ssl_ciphers            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] console.ssl_minimum_version    = default {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] consoleauth.token_ttl          = 600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.cafile                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.certfile                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.collect_timing          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.connect_retries         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.connect_retry_delay     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.endpoint_override       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.insecure                = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.keyfile                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.max_version             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.min_version             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.region_name             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.service_name            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.service_type            = accelerator {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.split_loggers           = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.status_code_retries     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.status_code_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.timeout                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] cyborg.version                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.backend               = sqlalchemy {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.connection            = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.connection_debug      = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.connection_parameters =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.connection_recycle_time = 3600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.connection_trace      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.db_inc_retry_interval = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.db_max_retries        = 20 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.db_max_retry_interval = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.db_retry_interval     = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.max_overflow          = 50 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.max_pool_size         = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.max_retries           = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.mysql_wsrep_sync_wait = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.pool_timeout          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.retry_interval        = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.slave_connection      = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] database.sqlite_synchronous    = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.backend           = sqlalchemy {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.connection        = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.connection_debug  = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.connection_parameters =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.connection_recycle_time = 3600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.connection_trace  = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.db_inc_retry_interval = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.db_max_retries    = 20 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.db_max_retry_interval = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.db_retry_interval = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.max_overflow      = 50 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.max_pool_size     = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.max_retries       = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.pool_timeout      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.retry_interval    = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.slave_connection  = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] api_database.sqlite_synchronous = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] devices.enabled_mdev_types     = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ephemeral_storage_encryption.enabled = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.api_servers             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.cafile                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.certfile                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.collect_timing          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.connect_retries         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.connect_retry_delay     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.debug                   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.default_trusted_certificate_ids = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.enable_certificate_validation = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.enable_rbd_download     = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.endpoint_override       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.insecure                = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.keyfile                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.max_version             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.min_version             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.num_retries             = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.rbd_ceph_conf           =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.rbd_connect_timeout     = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.rbd_pool                =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.rbd_user                =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.region_name             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.service_name            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.service_type            = image {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.split_loggers           = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.status_code_retries     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.status_code_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.timeout                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.verify_glance_signatures = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] glance.version                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] guestfs.debug                  = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.config_drive_cdrom      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.config_drive_inject_password = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.enable_remotefx         = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.instances_path_share    =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.limit_cpu_features      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.use_multipath_io        = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.vswitch_name            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] mks.enabled                    = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] image_cache.manager_interval   = 2400 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] image_cache.precache_concurrency = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] image_cache.remove_unused_base_images = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] image_cache.subdirectory_name  = _base {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.api_max_retries         = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.api_retry_interval      = 2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.auth_section            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.auth_type               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.cafile                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.certfile                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.collect_timing          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.conductor_group         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.connect_retries         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.connect_retry_delay     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.endpoint_override       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.insecure                = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.keyfile                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.max_version             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.min_version             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.peer_list               = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.region_name             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.serial_console_state_timeout = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:20 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.service_name            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.service_type            = baremetal {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.split_loggers           = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.status_code_retries     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.status_code_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.timeout                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ironic.version                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] key_manager.fixed_key          = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.barbican_api_version  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.barbican_endpoint     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.barbican_endpoint_type = public {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.barbican_region_name  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.cafile                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.certfile              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.collect_timing        = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.insecure              = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.keyfile               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.number_of_retries     = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.retry_delay           = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.send_service_user_token = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.split_loggers         = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.timeout               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.verify_ssl            = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican.verify_ssl_path       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.auth_section = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.auth_type = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.cafile   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.certfile = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.collect_timing = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.insecure = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.keyfile  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.split_loggers = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] barbican_service_user.timeout  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.approle_role_id          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.approle_secret_id        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.cafile                   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.certfile                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.collect_timing           = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.insecure                 = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.keyfile                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.kv_mountpoint            = secret {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.kv_path                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.kv_version               = 2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.namespace                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.root_token_id            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.split_loggers            = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.ssl_ca_crt_file          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.timeout                  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.use_ssl                  = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.auth_section          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.auth_type             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.cafile                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.certfile              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.collect_timing        = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.connect_retries       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.connect_retry_delay   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.endpoint_override     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.insecure              = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.keyfile               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.max_version           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.min_version           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.region_name           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.service_name          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.service_type          = identity {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.split_loggers         = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.status_code_retries   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.status_code_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.timeout               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] keystone.version               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.connection_uri         =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.cpu_mode               = custom {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: WARNING oslo_config.cfg [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.cpu_power_governor_high = performance {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.cpu_power_management   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.device_detach_attempts = 8 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.device_detach_timeout  = 20 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.disk_cachemodes        = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.disk_prefix            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.enabled_perf_events    = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.file_backed_memory     = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.gid_maps               = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.hw_disk_discard        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.hw_machine_type        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.images_rbd_pool        = rbd {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.images_type            = default {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.images_volume_group    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.inject_key             = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.inject_partition       = -2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.inject_password        = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.iscsi_iface            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.iser_use_multipath     = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_downtime = 500 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_inbound_addr = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_scheme  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_timeout_action = abort {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_tunnelled = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: WARNING oslo_config.cfg [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 21 14:13:21 user nova-compute[74882]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 21 14:13:21 user nova-compute[74882]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 21 14:13:21 user nova-compute[74882]: and ``live_migration_inbound_addr`` respectively.
Nov 21 14:13:21 user nova-compute[74882]: ).  Its value may be silently ignored in the future.
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.live_migration_with_native_tls = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.max_queues             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.nfs_mount_options      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.num_pcie_ports         = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.pmem_namespaces        = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.quobyte_client_cfg     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rbd_secret_uuid        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rbd_user               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rescue_image_id        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rescue_kernel_id       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.rx_queue_size          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.smbfs_mount_options    =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.snapshot_compression   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.snapshot_image_format  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.sparse_logical_volumes = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.swtpm_enabled          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.swtpm_group            = tss {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.swtpm_user             = tss {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.sysinfo_serial         = unique {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.tb_cache_size          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.tx_queue_size          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.uid_maps               = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.use_virtio_for_bridges = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.virt_type              = kvm {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.volume_clear           = zero {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.volume_clear_size      = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.volume_use_multipath   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.vzstorage_cache_path   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.auth_section           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.auth_type              = password {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.cafile                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.certfile               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.collect_timing         = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.connect_retries        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.connect_retry_delay    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.default_floating_pool  = public {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.endpoint_override      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.extension_sync_interval = 600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.http_retries           = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.insecure               = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.keyfile                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.max_version            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.min_version            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.ovs_bridge             = br-int {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.physnets               = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.region_name            = RegionOne {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.service_metadata_proxy = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.service_name           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.service_type           = network {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.split_loggers          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.status_code_retries    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.status_code_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.timeout                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] neutron.version                = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] notifications.bdms_in_notifications = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] notifications.default_level    = INFO {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] notifications.notification_format = unversioned {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] notifications.notify_on_state_change = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] pci.alias                      = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] pci.device_spec                = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] pci.report_in_placement        = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.auth_section         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.auth_type            = password {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.cafile               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.certfile             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.collect_timing       = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.connect_retries      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.connect_retry_delay  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.default_domain_id    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.default_domain_name  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.domain_id            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.domain_name          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.endpoint_override    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.insecure             = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.keyfile              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.max_version          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.min_version          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.password             = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.project_domain_id    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.project_domain_name  = Default {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.project_id           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.project_name         = service {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.region_name          = RegionOne {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.service_name         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.service_type         = placement {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.split_loggers        = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.status_code_retries  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.status_code_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.system_scope         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.timeout              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.trust_id             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.user_domain_id       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.user_domain_name     = Default {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.user_id              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.username             = placement {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] placement.version              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.cores                    = 20 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.count_usage_from_placement = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.injected_file_content_bytes = 10240 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.injected_file_path_length = 255 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.injected_files           = 5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.instances                = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.key_pairs                = 100 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.metadata_items           = 128 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.ram                      = 51200 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.recheck_quota            = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.server_group_members     = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] quota.server_groups            = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rdp.enabled                    = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.image_metadata_prefilter = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.max_attempts         = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.max_placement_results = 1000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] scheduler.workers              = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.host_subset_size = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.isolated_hosts = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.isolated_images = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.pci_in_placement = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.track_instance_changes = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] metrics.required               = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] metrics.weight_multiplier      = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] metrics.weight_setting         = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] serial_console.enabled         = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] serial_console.port_range      = 10000:20000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] serial_console.serialproxy_port = 6083 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.auth_section      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.auth_type         = password {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.cafile            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.certfile          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.collect_timing    = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.insecure          = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.keyfile           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.send_service_user_token = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.split_loggers     = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] service_user.timeout           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.agent_enabled            = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.enabled                  = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.html5proxy_port          = 6082 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.image_compression        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.jpeg_compression         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.playback_compression     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.server_listen            = 127.0.0.1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.streaming_mode           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] spice.zlib_compression         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] upgrade_levels.baseapi         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] upgrade_levels.compute         = auto {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] upgrade_levels.conductor       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] upgrade_levels.scheduler       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.cafile = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.certfile = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.insecure = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vendordata_dynamic_auth.timeout = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.api_retry_count         = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.ca_file                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.cache_prefix            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.cluster_name            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.connection_pool_size    = 10 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.console_delay_seconds   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.datastore_regex         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.host_ip                 = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.host_password           = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.host_port               = 443 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.host_username           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.insecure                = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.integration_bridge      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.maximum_objects         = 100 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.pbm_default_policy      = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.pbm_enabled             = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.pbm_wsdl_location       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.serial_port_proxy_uri   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.serial_port_service_uri = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.task_poll_interval      = 0.5 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.use_linked_clone        = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.vnc_keymap              = en-us {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.vnc_port                = 5900 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vmware.vnc_port_total          = 10000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.auth_schemes               = ['none'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.enabled                    = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.novncproxy_port            = 6080 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.vencrypt_ca_certs          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.vencrypt_client_cert       = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vnc.vencrypt_client_key        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.disable_rootwrap   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.enable_numa_live_migration = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.libvirt_disable_apic = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.client_socket_timeout     = 900 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.default_pool_size         = 1000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.keep_alive                = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.max_header_line           = 16384 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.ssl_ca_file               = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.ssl_cert_file             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.ssl_key_file              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.tcp_keepidle              = 600 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] zvm.ca_file                    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] zvm.cloud_connector_url        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] zvm.reachable_timeout          = 300 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.enforce_new_defaults = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.enforce_scope      = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.policy_default_rule = default {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.connection_string     = messaging:// {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.enabled               = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.es_doc_type           = notification {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.es_scroll_size        = 10000 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.es_scroll_time        = 2m {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.filter_error_trace    = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.hmac_keys             = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.sentinel_service_name = mymaster {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.socket_timeout        = 0.1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.trace_requests        = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler.trace_sqlalchemy      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler_jaeger.process_tags   = {} {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler_jaeger.service_name_prefix = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] profiler_otlp.service_name_prefix = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] remote_debug.host              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] remote_debug.port              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_notifications.retry = -1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.auth_section        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.auth_type           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.cafile              = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.certfile            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.collect_timing      = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.connect_retries     = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.connect_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.endpoint_id         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.endpoint_override   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.insecure            = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.keyfile             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.max_version         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.min_version         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.region_name         = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.service_name        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.service_type        = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.split_loggers       = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.status_code_retries = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.status_code_retry_delay = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.timeout             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.valid_interfaces    = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_limit.version             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_reports.file_event_handler = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] oslo_reports.log_dir           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_ovs_privileged.group  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] vif_plug_ovs_privileged.user   = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_ovs.isolate_vif         = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] os_brick.lock_path             = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] privsep_osbrick.capabilities   = [21] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] privsep_osbrick.group          = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] privsep_osbrick.helper_command = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] privsep_osbrick.user           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] nova_sys_admin.group           = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] nova_sys_admin.helper_command  = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] nova_sys_admin.user            = None {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG oslo_service.service [None req-d3f38be8-8271-425a-b230-52b9ac82fdb4 None None] ******************************************************************************** {{(pid=74882) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 21 14:13:21 user nova-compute[74882]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 21 14:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Connecting to libvirt: qemu:///system {{(pid=74882) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f6d94bde560> {{(pid=74882) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 21 14:13:21 user nova-compute[74882]: libvirt:  error : internal error: could not initialize domain event timer
Nov 21 14:13:21 user nova-compute[74882]: WARNING nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 21 14:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f6d94bde560> {{(pid=74882) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Starting native event thread {{(pid=74882) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Starting green dispatch thread {{(pid=74882) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 21 14:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Starting connection event dispatch thread {{(pid=74882) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 21 14:13:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Connection event '1' reason 'None'
Nov 21 14:13:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 21 14:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.mount [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Initialising _HostMountState generation 0 {{(pid=74882) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 21 14:13:28 user nova-compute[74882]: INFO nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host capabilities <capabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <host>
Nov 21 14:13:28 user nova-compute[74882]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 21 14:13:28 user nova-compute[74882]:     <cpu>
Nov 21 14:13:28 user nova-compute[74882]:       <arch>x86_64</arch>
Nov 21 14:13:28 user nova-compute[74882]:       <model>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <microcode version='1070'/>
Nov 21 14:13:28 user nova-compute[74882]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 21 14:13:28 user nova-compute[74882]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='osxsave'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='invtsc'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='rsba'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature name='skip-l1dfl-vmentry'/>
Nov 21 14:13:28 user nova-compute[74882]:       <pages unit='KiB' size='4'/>
Nov 21 14:13:28 user nova-compute[74882]:       <pages unit='KiB' size='2048'/>
Nov 21 14:13:28 user nova-compute[74882]:     </cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <power_management>
Nov 21 14:13:28 user nova-compute[74882]:       <suspend_mem/>
Nov 21 14:13:28 user nova-compute[74882]:       <suspend_disk/>
Nov 21 14:13:28 user nova-compute[74882]:       <suspend_hybrid/>
Nov 21 14:13:28 user nova-compute[74882]:     </power_management>
Nov 21 14:13:28 user nova-compute[74882]:     <iommu support='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <migration_features>
Nov 21 14:13:28 user nova-compute[74882]:       <live/>
Nov 21 14:13:28 user nova-compute[74882]:       <uri_transports>
Nov 21 14:13:28 user nova-compute[74882]:         <uri_transport>tcp</uri_transport>
Nov 21 14:13:28 user nova-compute[74882]:         <uri_transport>rdma</uri_transport>
Nov 21 14:13:28 user nova-compute[74882]:       </uri_transports>
Nov 21 14:13:28 user nova-compute[74882]:     </migration_features>
Nov 21 14:13:28 user nova-compute[74882]:     <topology>
Nov 21 14:13:28 user nova-compute[74882]:       <cells num='2'>
Nov 21 14:13:28 user nova-compute[74882]:         <cell id='0'>
Nov 21 14:13:28 user nova-compute[74882]:           <memory unit='KiB'>8140616</memory>
Nov 21 14:13:28 user nova-compute[74882]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 21 14:13:28 user nova-compute[74882]:           <pages unit='KiB' size='2048'>0</pages>
Nov 21 14:13:28 user nova-compute[74882]:           <distances>
Nov 21 14:13:28 user nova-compute[74882]:             <sibling id='0' value='10'/>
Nov 21 14:13:28 user nova-compute[74882]:             <sibling id='1' value='20'/>
Nov 21 14:13:28 user nova-compute[74882]:           </distances>
Nov 21 14:13:28 user nova-compute[74882]:           <cpus num='6'>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 21 14:13:28 user nova-compute[74882]:           </cpus>
Nov 21 14:13:28 user nova-compute[74882]:         </cell>
Nov 21 14:13:28 user nova-compute[74882]:         <cell id='1'>
Nov 21 14:13:28 user nova-compute[74882]:           <memory unit='KiB'>8255068</memory>
Nov 21 14:13:28 user nova-compute[74882]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 21 14:13:28 user nova-compute[74882]:           <pages unit='KiB' size='2048'>0</pages>
Nov 21 14:13:28 user nova-compute[74882]:           <distances>
Nov 21 14:13:28 user nova-compute[74882]:             <sibling id='0' value='20'/>
Nov 21 14:13:28 user nova-compute[74882]:             <sibling id='1' value='10'/>
Nov 21 14:13:28 user nova-compute[74882]:           </distances>
Nov 21 14:13:28 user nova-compute[74882]:           <cpus num='6'>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 21 14:13:28 user nova-compute[74882]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 21 14:13:28 user nova-compute[74882]:           </cpus>
Nov 21 14:13:28 user nova-compute[74882]:         </cell>
Nov 21 14:13:28 user nova-compute[74882]:       </cells>
Nov 21 14:13:28 user nova-compute[74882]:     </topology>
Nov 21 14:13:28 user nova-compute[74882]:     <cache>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 21 14:13:28 user nova-compute[74882]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 21 14:13:28 user nova-compute[74882]:     </cache>
Nov 21 14:13:28 user nova-compute[74882]:     <secmodel>
Nov 21 14:13:28 user nova-compute[74882]:       <model>apparmor</model>
Nov 21 14:13:28 user nova-compute[74882]:       <doi>0</doi>
Nov 21 14:13:28 user nova-compute[74882]:     </secmodel>
Nov 21 14:13:28 user nova-compute[74882]:     <secmodel>
Nov 21 14:13:28 user nova-compute[74882]:       <model>dac</model>
Nov 21 14:13:28 user nova-compute[74882]:       <doi>0</doi>
Nov 21 14:13:28 user nova-compute[74882]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 21 14:13:28 user nova-compute[74882]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 21 14:13:28 user nova-compute[74882]:     </secmodel>
Nov 21 14:13:28 user nova-compute[74882]:   </host>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='alpha'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>clipper</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='armv6l'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>integratorcp</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>borzoi</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>spitz</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>nuri</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>musca-b1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>versatileab</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>kzm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>musca-a</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>smdkc210</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sx1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>z2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>tosa</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>sabrelite</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>realview-eb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>n810</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>n800</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>versatilepb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>terrier</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mainstone</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>midway</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>musicpal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>microbit</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>cubieboard</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>verdex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>netduino2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>raspi2b</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>cheetah</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>highbank</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>akita</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>connex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>collie</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>raspi0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='armv7l'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>integratorcp</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>borzoi</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>spitz</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>nuri</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>musca-b1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>versatileab</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>kzm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>musca-a</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>smdkc210</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sx1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>z2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>tosa</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>sabrelite</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>realview-eb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>n810</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>n800</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>versatilepb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>terrier</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mainstone</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>midway</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>musicpal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>microbit</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>cubieboard</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>verdex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>netduino2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>raspi2b</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>cheetah</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>highbank</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>akita</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>connex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>collie</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>raspi0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='aarch64'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>integratorcp</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>borzoi</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>spitz</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>nuri</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>musca-b1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>versatileab</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>kzm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>musca-a</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>smdkc210</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sx1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>z2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>tosa</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>sabrelite</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>realview-eb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>n810</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>n800</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>versatilepb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>terrier</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mainstone</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>midway</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>musicpal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>microbit</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>cubieboard</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>verdex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>netduino2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>raspi3b</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>raspi2b</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>cheetah</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>highbank</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>akita</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>connex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>collie</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>raspi0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <acpi default='on' toggle='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='cris'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='i686'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>x-remote</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>isapc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>microvm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='kvm'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <pae/>
Nov 21 14:13:28 user nova-compute[74882]:       <nonpae/>
Nov 21 14:13:28 user nova-compute[74882]:       <acpi default='on' toggle='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:       <apic default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='m68k'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>an5206</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>q800</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>next-cube</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='microblaze'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='microblazeel'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='mips'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='16'>malta</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mipssim</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='mipsel'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='16'>malta</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mipssim</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='mips64'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='16'>malta</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mipssim</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>pica61</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>magnum</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='mips64el'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='16'>malta</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mipssim</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>pica61</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>magnum</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='16'>boston</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='ppc'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>g3beige</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mac99</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>ppce500</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>pegasos2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sam460ex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>bamboo</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>40p</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>ref405ep</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>taihu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='ppc64'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2048'>powernv9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>taihu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2048'>powernv10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>ppce500</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>40p</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>pegasos2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>bamboo</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>g3beige</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mac99</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sam460ex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>ref405ep</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2048'>powernv8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='ppc64le'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2048'>powernv9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>taihu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2048'>powernv10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>ppce500</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>40p</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>pegasos2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>bamboo</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>g3beige</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>mac99</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sam460ex</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>ref405ep</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2048'>powernv8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='riscv32'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='8'>spike</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>opentitan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='5'>sifive_u</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sifive_e</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='8'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='riscv64'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='8'>spike</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='5'>sifive_u</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>shakti_c</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sifive_e</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='8'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='s390x'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='sh4'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>shix</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>r2d</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='sh4eb'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>shix</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>r2d</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='sparc'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>SS-5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>SS-20</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>LX</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>SS-4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>SS-10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>Voyager</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='sparc64'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sun4u</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>niagara</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>sun4v</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='x86_64'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>64</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>x-remote</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='1'>isapc</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>microvm</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='kvm'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <acpi default='on' toggle='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:       <apic default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='xtensa'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>sim</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>kc705</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>ml605</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx200</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx60</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]:   <guest>
Nov 21 14:13:28 user nova-compute[74882]:     <os_type>hvm</os_type>
Nov 21 14:13:28 user nova-compute[74882]:     <arch name='xtensaeb'>
Nov 21 14:13:28 user nova-compute[74882]:       <wordsize>32</wordsize>
Nov 21 14:13:28 user nova-compute[74882]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='4'>sim</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>kc705</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>ml605</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>virt</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx200</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>lx60</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 21 14:13:28 user nova-compute[74882]:       <domain type='qemu'/>
Nov 21 14:13:28 user nova-compute[74882]:     </arch>
Nov 21 14:13:28 user nova-compute[74882]:     <features>
Nov 21 14:13:28 user nova-compute[74882]:       <cpuselection/>
Nov 21 14:13:28 user nova-compute[74882]:       <deviceboot/>
Nov 21 14:13:28 user nova-compute[74882]:       <disksnapshot default='on' toggle='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     </features>
Nov 21 14:13:28 user nova-compute[74882]:   </guest>
Nov 21 14:13:28 user nova-compute[74882]: </capabilities>
Nov 21 14:13:28 user nova-compute[74882]: 
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-i386</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-i440fx-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>i686</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='255'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'/>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='lm'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ide</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-i386</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-q35-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>i686</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='288'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'/>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='lm'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-i386</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-i440fx-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>i686</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='255'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'/>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='lm'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ide</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-i386</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-q35-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>i686</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='288'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'/>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='lm'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-i440fx-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>x86_64</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='255'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>efi</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='invtsc'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='rsba'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pschange-mc-no'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ide</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-q35-6.2</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>x86_64</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='288'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>efi</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='invtsc'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='rsba'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pschange-mc-no'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-i440fx-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>x86_64</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='255'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>efi</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='invtsc'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='rsba'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pschange-mc-no'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ide</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 21 14:13:28 user nova-compute[74882]: <domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 21 14:13:28 user nova-compute[74882]:   <domain>kvm</domain>
Nov 21 14:13:28 user nova-compute[74882]:   <machine>pc-q35-jammy</machine>
Nov 21 14:13:28 user nova-compute[74882]:   <arch>x86_64</arch>
Nov 21 14:13:28 user nova-compute[74882]:   <vcpu max='288'/>
Nov 21 14:13:28 user nova-compute[74882]:   <iothreads supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:   <os supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='firmware'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>efi</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:     <loader supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>rom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pflash</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='readonly'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='secure'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>yes</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>no</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </loader>
Nov 21 14:13:28 user nova-compute[74882]:   </os>
Nov 21 14:13:28 user nova-compute[74882]:   <cpu>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-passthrough' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='hostPassthroughMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='maximum' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='maximumMigratable'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>on</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>off</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='host-model' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <vendor>Intel</vendor>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ss'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='vmx'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pcid'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='hypervisor'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arat'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='tsc_adjust'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='umip'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='md-clear'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='arch-capabilities'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='invtsc'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibpb'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='ibrs'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-stibp'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='amd-ssbd'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='rsba'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='require' name='pschange-mc-no'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='erms'/>
Nov 21 14:13:28 user nova-compute[74882]:       <feature policy='disable' name='xsaveopt'/>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:     <mode name='custom' supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>qemu64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>qemu32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>phenom</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>pentium</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>n270</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm64</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>kvm32</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>coreduo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>core2duo</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>athlon</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Westmere</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Snowridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Skylake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>SandyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Penryn</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G5</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G4</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G3</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Opteron_G2</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Opteron_G1</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>IvyBridge</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Icelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Haswell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Rome</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-Milan</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC-IBPB</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>EPYC</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Dhyana</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cooperlake</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>Conroe</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Cascadelake-Server</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-noTSX</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell-IBRS</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='no'>Broadwell</model>
Nov 21 14:13:28 user nova-compute[74882]:       <model usable='yes'>486</model>
Nov 21 14:13:28 user nova-compute[74882]:     </mode>
Nov 21 14:13:28 user nova-compute[74882]:   </cpu>
Nov 21 14:13:28 user nova-compute[74882]:   <memoryBacking supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:     <enum name='sourceType'>
Nov 21 14:13:28 user nova-compute[74882]:       <value>file</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>anonymous</value>
Nov 21 14:13:28 user nova-compute[74882]:       <value>memfd</value>
Nov 21 14:13:28 user nova-compute[74882]:     </enum>
Nov 21 14:13:28 user nova-compute[74882]:   </memoryBacking>
Nov 21 14:13:28 user nova-compute[74882]:   <devices>
Nov 21 14:13:28 user nova-compute[74882]:     <disk supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='diskDevice'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>disk</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cdrom</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>floppy</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>lun</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='bus'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>fdc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sata</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </disk>
Nov 21 14:13:28 user nova-compute[74882]:     <graphics supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='type'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>sdl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vnc</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>spice</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egl-headless</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </graphics>
Nov 21 14:13:28 user nova-compute[74882]:     <video supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='modelType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>cirrus</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>vmvga</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>qxl</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>none</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>bochs</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>ramfb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </video>
Nov 21 14:13:28 user nova-compute[74882]:     <hostdev supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='mode'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>subsystem</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='startupPolicy'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>default</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>mandatory</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>requisite</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>optional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='subsysType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>usb</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>pci</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>scsi</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='capsType'/>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='pciBackend'/>
Nov 21 14:13:28 user nova-compute[74882]:     </hostdev>
Nov 21 14:13:28 user nova-compute[74882]:     <rng supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtio-non-transitional</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>random</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>egd</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>builtin</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </rng>
Nov 21 14:13:28 user nova-compute[74882]:     <filesystem supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='driverType'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>path</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>handle</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>virtiofs</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </filesystem>
Nov 21 14:13:28 user nova-compute[74882]:     <tpm supported='yes'>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='model'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-tis</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>tpm-crb</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:       <enum name='backendModel'>
Nov 21 14:13:28 user nova-compute[74882]:         <value>passthrough</value>
Nov 21 14:13:28 user nova-compute[74882]:         <value>emulator</value>
Nov 21 14:13:28 user nova-compute[74882]:       </enum>
Nov 21 14:13:28 user nova-compute[74882]:     </tpm>
Nov 21 14:13:28 user nova-compute[74882]:   </devices>
Nov 21 14:13:28 user nova-compute[74882]:   <features>
Nov 21 14:13:28 user nova-compute[74882]:     <gic supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:     <vmcoreinfo supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <genid supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backingStoreInput supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <backup supported='yes'/>
Nov 21 14:13:28 user nova-compute[74882]:     <sev supported='no'/>
Nov 21 14:13:28 user nova-compute[74882]:   </features>
Nov 21 14:13:28 user nova-compute[74882]: </domainCapabilities>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74882) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74882) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Checking secure boot support for host arch (x86_64) {{(pid=74882) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Checking secure boot support for host arch (x86_64) {{(pid=74882) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Checking secure boot support for host arch (x86_64) {{(pid=74882) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 21 14:13:28 user nova-compute[74882]: INFO nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Secure Boot support detected
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] cpu compare xml: <cpu match="exact">
Nov 21 14:13:28 user nova-compute[74882]:   <model>Nehalem</model>
Nov 21 14:13:28 user nova-compute[74882]: </cpu>
Nov 21 14:13:28 user nova-compute[74882]:  {{(pid=74882) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 21 14:13:28 user nova-compute[74882]: INFO nova.virt.node [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Generated node identity f2c18da1-f4fd-49b6-a78a-043389a6ebfc
Nov 21 14:13:28 user nova-compute[74882]: INFO nova.virt.node [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Wrote node identity f2c18da1-f4fd-49b6-a78a-043389a6ebfc to /opt/stack/data/nova/compute_id
Nov 21 14:13:28 user nova-compute[74882]: WARNING nova.compute.manager [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Compute nodes ['f2c18da1-f4fd-49b6-a78a-043389a6ebfc'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 21 14:13:28 user nova-compute[74882]: INFO nova.compute.manager [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 21 14:13:28 user nova-compute[74882]: WARNING nova.compute.manager [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 21 14:13:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:13:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:13:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:13:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Hypervisor/Node resource view: name=user free_ram=10958MB free_disk=26.15587615966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:13:29 user nova-compute[74882]: WARNING nova.compute.resource_tracker [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] No compute node record for user:f2c18da1-f4fd-49b6-a78a-043389a6ebfc: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f2c18da1-f4fd-49b6-a78a-043389a6ebfc could not be found.
Nov 21 14:13:29 user nova-compute[74882]: INFO nova.compute.resource_tracker [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Compute node record created for user:user with uuid: f2c18da1-f4fd-49b6-a78a-043389a6ebfc
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:13:29 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] [req-d1263156-8a30-47a4-83ac-a5b4f04960dc] Created resource provider record via placement API for resource provider with UUID f2c18da1-f4fd-49b6-a78a-043389a6ebfc and name user.
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74882) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 21 14:13:29 user nova-compute[74882]: INFO nova.virt.libvirt.host [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] kernel doesn't support AMD SEV
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Libvirt baseline CPU <cpu>
Nov 21 14:13:29 user nova-compute[74882]:   <arch>x86_64</arch>
Nov 21 14:13:29 user nova-compute[74882]:   <model>Nehalem</model>
Nov 21 14:13:29 user nova-compute[74882]:   <vendor>Intel</vendor>
Nov 21 14:13:29 user nova-compute[74882]:   <topology sockets="6" cores="1" threads="1"/>
Nov 21 14:13:29 user nova-compute[74882]: </cpu>
Nov 21 14:13:29 user nova-compute[74882]:  {{(pid=74882) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Updated inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Updating resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc generation from 0 to 1 during operation: update_inventory {{(pid=74882) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Updating resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc generation from 1 to 2 during operation: update_traits {{(pid=74882) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.service [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Creating RPC server for service compute {{(pid=74882) start /opt/stack/nova/nova/service.py:182}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.service [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] Join ServiceGroup membership for this service compute {{(pid=74882) start /opt/stack/nova/nova/service.py:199}}
Nov 21 14:13:29 user nova-compute[74882]: DEBUG nova.servicegroup.drivers.db [None req-3dbaf2f2-e11a-4e2c-b27a-6b23f4f7a6bb None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74882) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 21 14:14:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:14:20 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:14:20 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:14:20 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=10377MB free_disk=26.059711456298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:14:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:14:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:14:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:14:21 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:14:21 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:14:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:14:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:15:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:15:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=10305MB free_disk=26.12466812133789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:15:21 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:15:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:15:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:15:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:16:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:16:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:16:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=10290MB free_disk=25.87661361694336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:16:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:16:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:16:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:16:22 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:16:22 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:16:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:16:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:16:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:17:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9619MB free_disk=25.89727783203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:17:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:17:22 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:17:22 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:17:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:17:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:17:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:17:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:17:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:17:27 user nova-compute[74882]: INFO nova.compute.claims [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Claim successful on node user
Nov 21 14:17:27 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:17:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:17:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:17:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Creating image(s)
Nov 21 14:17:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "/opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "/opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:28 user nova-compute[74882]: DEBUG nova.policy [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd20e3b99a4f246eb89174a4e87e5da4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1a7387e11d461088e466338a2804e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG nova.virt.images [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 56f0cfc7-adc4-437a-accc-8a2f8cd4e785 was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.part /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Successfully created port: 932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.part /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.converted" returned: 0 in 0.228s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d.converted --force-share --output=json" returned: 0 in 0.341s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.889s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:30 user nova-compute[74882]: INFO oslo.privsep.daemon [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxqp1kh7h/privsep.sock']
Nov 21 14:17:30 user sudo[84123]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxqp1kh7h/privsep.sock
Nov 21 14:17:30 user sudo[84123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Successfully updated port: 932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquired lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:17:31 user nova-compute[74882]: INFO nova.compute.claims [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Claim successful on node user
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received event network-changed-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Refreshing instance network info cache due to event network-changed-932be03a-30bb-4fd3-bfed-064cb3a73698. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Acquiring lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:17:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:17:31 user sudo[84123]: pam_unix(sudo:session): session closed for user root
Nov 21 14:17:31 user nova-compute[74882]: INFO oslo.privsep.daemon [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Spawned new privsep daemon via rootwrap
Nov 21 14:17:31 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 21 14:17:31 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 21 14:17:31 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 21 14:17:31 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84133
Nov 21 14:17:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:17:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.policy [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.210s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:17:32 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Creating image(s)
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "/opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "/opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updating instance_info_cache with network_info: [{"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Releasing lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Instance network_info: |[{"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Acquired lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Refreshing network info cache for port 932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk 1073741824" returned: 0 in 0.050s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.036s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk 1073741824" returned: 0 in 0.047s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Cannot resize image /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Ensure instance console log exists: /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Start _get_guest_xml network_info=[{"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:17:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1455144124',display_name='tempest-DeleteServersTestJSON-server-1455144124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1455144124',id=1,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df1a7387e11d461088e466338a2804e2',ramdisk_id='',reservation_id='r-jf4tnhdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1173355209',owner_user_name='tempest-DeleteServersTestJSON-1173355209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:28Z,user_data=None,user_id='d20e3b99a4f246eb89174a4e87e5da4a',uuid=c8f0dc3a-93fe-4de4-b362-1a71696277bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Converting VIF {"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=932be03a-30bb-4fd3-bfed-064cb3a73698,network=Network(fd9e560f-4f37-4aa6-8f88-8dbb8870100b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932be03a-30') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lazy-loading 'pci_devices' on Instance uuid c8f0dc3a-93fe-4de4-b362-1a71696277bf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:17:32 user nova-compute[74882]:   <uuid>c8f0dc3a-93fe-4de4-b362-1a71696277bf</uuid>
Nov 21 14:17:32 user nova-compute[74882]:   <name>instance-00000001</name>
Nov 21 14:17:32 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:17:32 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:17:32 user nova-compute[74882]:   <metadata>
Nov 21 14:17:32 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:17:32 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:17:32 user nova-compute[74882]:       <nova:name>tempest-DeleteServersTestJSON-server-1455144124</nova:name>
Nov 21 14:17:32 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:17:32</nova:creationTime>
Nov 21 14:17:32 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:17:32 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:17:32 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:17:32 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:17:32 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:17:32 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:17:32 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:17:32 user nova-compute[74882]:       <nova:owner>
Nov 21 14:17:32 user nova-compute[74882]:         <nova:user uuid="d20e3b99a4f246eb89174a4e87e5da4a">tempest-DeleteServersTestJSON-1173355209-project-member</nova:user>
Nov 21 14:17:32 user nova-compute[74882]:         <nova:project uuid="df1a7387e11d461088e466338a2804e2">tempest-DeleteServersTestJSON-1173355209</nova:project>
Nov 21 14:17:32 user nova-compute[74882]:       </nova:owner>
Nov 21 14:17:32 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:17:32 user nova-compute[74882]:       <nova:ports>
Nov 21 14:17:32 user nova-compute[74882]:         <nova:port uuid="932be03a-30bb-4fd3-bfed-064cb3a73698">
Nov 21 14:17:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 21 14:17:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:17:32 user nova-compute[74882]:       </nova:ports>
Nov 21 14:17:32 user nova-compute[74882]:     </nova:instance>
Nov 21 14:17:32 user nova-compute[74882]:   </metadata>
Nov 21 14:17:32 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:17:32 user nova-compute[74882]:     <system>
Nov 21 14:17:32 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:17:32 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:17:32 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:17:32 user nova-compute[74882]:       <entry name="serial">c8f0dc3a-93fe-4de4-b362-1a71696277bf</entry>
Nov 21 14:17:32 user nova-compute[74882]:       <entry name="uuid">c8f0dc3a-93fe-4de4-b362-1a71696277bf</entry>
Nov 21 14:17:32 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:17:32 user nova-compute[74882]:     </system>
Nov 21 14:17:32 user nova-compute[74882]:   </sysinfo>
Nov 21 14:17:32 user nova-compute[74882]:   <os>
Nov 21 14:17:32 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:17:32 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:17:32 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:17:32 user nova-compute[74882]:   </os>
Nov 21 14:17:32 user nova-compute[74882]:   <features>
Nov 21 14:17:32 user nova-compute[74882]:     <acpi/>
Nov 21 14:17:32 user nova-compute[74882]:     <apic/>
Nov 21 14:17:32 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:17:32 user nova-compute[74882]:   </features>
Nov 21 14:17:32 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:17:32 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:17:32 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:17:32 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:17:32 user nova-compute[74882]:   </clock>
Nov 21 14:17:32 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:17:32 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:17:32 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:17:32 user nova-compute[74882]:   </cpu>
Nov 21 14:17:32 user nova-compute[74882]:   <devices>
Nov 21 14:17:32 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:17:32 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:17:32 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk"/>
Nov 21 14:17:32 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:17:32 user nova-compute[74882]:     </disk>
Nov 21 14:17:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:17:32 user nova-compute[74882]:       <mac address="fa:16:3e:b0:94:fa"/>
Nov 21 14:17:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:17:32 user nova-compute[74882]:       <target dev="tap932be03a-30"/>
Nov 21 14:17:32 user nova-compute[74882]:     </interface>
Nov 21 14:17:32 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:17:32 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/console.log" append="off"/>
Nov 21 14:17:32 user nova-compute[74882]:     </serial>
Nov 21 14:17:32 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:17:32 user nova-compute[74882]:     <video>
Nov 21 14:17:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:32 user nova-compute[74882]:     </video>
Nov 21 14:17:32 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:17:32 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:17:32 user nova-compute[74882]:     </rng>
Nov 21 14:17:32 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:17:32 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:17:32 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:17:32 user nova-compute[74882]:     </memballoon>
Nov 21 14:17:32 user nova-compute[74882]:   </devices>
Nov 21 14:17:32 user nova-compute[74882]: </domain>
Nov 21 14:17:32 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1455144124',display_name='tempest-DeleteServersTestJSON-server-1455144124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1455144124',id=1,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df1a7387e11d461088e466338a2804e2',ramdisk_id='',reservation_id='r-jf4tnhdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1173355209',owner_user_name='tempest-DeleteServersTestJSON-1173355209-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:28Z,user_data=None,user_id='d20e3b99a4f246eb89174a4e87e5da4a',uuid=c8f0dc3a-93fe-4de4-b362-1a71696277bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Converting VIF {"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=932be03a-30bb-4fd3-bfed-064cb3a73698,network=Network(fd9e560f-4f37-4aa6-8f88-8dbb8870100b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932be03a-30') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:32 user nova-compute[74882]: DEBUG os_vif [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=932be03a-30bb-4fd3-bfed-064cb3a73698,network=Network(fd9e560f-4f37-4aa6-8f88-8dbb8870100b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932be03a-30') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Created schema index Interface.name {{(pid=74882) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Created schema index Port.name {{(pid=74882) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Created schema index Bridge.name {{(pid=74882) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [POLLOUT] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Cannot resize image /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Ensure instance console log exists: /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a03bbb59-1521-5ecb-849c-f6c6af458f36', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:33 user nova-compute[74882]: INFO oslo.privsep.daemon [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpo6px3vt5/privsep.sock']
Nov 21 14:17:33 user sudo[84169]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpo6px3vt5/privsep.sock
Nov 21 14:17:33 user sudo[84169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 21 14:17:34 user nova-compute[74882]: DEBUG nova.network.neutron [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updated VIF entry in instance network info cache for port 932be03a-30bb-4fd3-bfed-064cb3a73698. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:17:34 user nova-compute[74882]: DEBUG nova.network.neutron [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updating instance_info_cache with network_info: [{"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-557c53e1-a73b-4060-87fd-759c26825d8f req-afd33754-3bae-470f-ae0c-fd887cb8250d service nova] Releasing lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:34 user sudo[84169]: pam_unix(sudo:session): session closed for user root
Nov 21 14:17:34 user nova-compute[74882]: INFO oslo.privsep.daemon [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Spawned new privsep daemon via rootwrap
Nov 21 14:17:34 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 21 14:17:34 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 21 14:17:34 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 21 14:17:34 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84174
Nov 21 14:17:34 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Successfully created port: f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap932be03a-30, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap932be03a-30, col_values=(('qos', UUID('955ac489-6027-4f35-b06c-f00e7d17a493')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap932be03a-30, col_values=(('external_ids', {'iface-id': '932be03a-30bb-4fd3-bfed-064cb3a73698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:94:fa', 'vm-uuid': 'c8f0dc3a-93fe-4de4-b362-1a71696277bf'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:35 user nova-compute[74882]: INFO os_vif [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=932be03a-30bb-4fd3-bfed-064cb3a73698,network=Network(fd9e560f-4f37-4aa6-8f88-8dbb8870100b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932be03a-30')
Nov 21 14:17:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] No VIF found with MAC fa:16:3e:b0:94:fa, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:36 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Successfully updated port: f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:17:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquired lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:36 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received event network-changed-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Refreshing instance network info cache due to event network-changed-f173e853-6ea8-452e-8db2-e8a975c2f5df. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Acquiring lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updating instance_info_cache with network_info: [{"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Releasing lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Instance network_info: |[{"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Acquired lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.network.neutron [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Refreshing network info cache for port f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Start _get_guest_xml network_info=[{"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:17:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:17:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-716976770',display_name='tempest-ServersNegativeTestJSON-server-716976770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-716976770',id=2,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8612dc478d4a40babe74b1fbf45eac93',ramdisk_id='',reservation_id='r-01ejk0kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1655313892',owner_user_name='tempest-ServersNegativeTestJSON-1655313892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:32Z,user_data=None,user_id='ec7d58eda515420f8b815338d2efd377',uuid=ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converting VIF {"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d1:6f,bridge_name='br-int',has_traffic_filtering=True,id=f173e853-6ea8-452e-8db2-e8a975c2f5df,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf173e853-6e') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lazy-loading 'pci_devices' on Instance uuid ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:17:38 user nova-compute[74882]:   <uuid>ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca</uuid>
Nov 21 14:17:38 user nova-compute[74882]:   <name>instance-00000002</name>
Nov 21 14:17:38 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:17:38 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:17:38 user nova-compute[74882]:   <metadata>
Nov 21 14:17:38 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:17:38 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:17:38 user nova-compute[74882]:       <nova:name>tempest-ServersNegativeTestJSON-server-716976770</nova:name>
Nov 21 14:17:38 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:17:37</nova:creationTime>
Nov 21 14:17:38 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:17:38 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:17:38 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:17:38 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:17:38 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:17:38 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:17:38 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:17:38 user nova-compute[74882]:       <nova:owner>
Nov 21 14:17:38 user nova-compute[74882]:         <nova:user uuid="ec7d58eda515420f8b815338d2efd377">tempest-ServersNegativeTestJSON-1655313892-project-member</nova:user>
Nov 21 14:17:38 user nova-compute[74882]:         <nova:project uuid="8612dc478d4a40babe74b1fbf45eac93">tempest-ServersNegativeTestJSON-1655313892</nova:project>
Nov 21 14:17:38 user nova-compute[74882]:       </nova:owner>
Nov 21 14:17:38 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:17:38 user nova-compute[74882]:       <nova:ports>
Nov 21 14:17:38 user nova-compute[74882]:         <nova:port uuid="f173e853-6ea8-452e-8db2-e8a975c2f5df">
Nov 21 14:17:38 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 21 14:17:38 user nova-compute[74882]:         </nova:port>
Nov 21 14:17:38 user nova-compute[74882]:       </nova:ports>
Nov 21 14:17:38 user nova-compute[74882]:     </nova:instance>
Nov 21 14:17:38 user nova-compute[74882]:   </metadata>
Nov 21 14:17:38 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:17:38 user nova-compute[74882]:     <system>
Nov 21 14:17:38 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:17:38 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:17:38 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:17:38 user nova-compute[74882]:       <entry name="serial">ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca</entry>
Nov 21 14:17:38 user nova-compute[74882]:       <entry name="uuid">ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca</entry>
Nov 21 14:17:38 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:17:38 user nova-compute[74882]:     </system>
Nov 21 14:17:38 user nova-compute[74882]:   </sysinfo>
Nov 21 14:17:38 user nova-compute[74882]:   <os>
Nov 21 14:17:38 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:17:38 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:17:38 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:17:38 user nova-compute[74882]:   </os>
Nov 21 14:17:38 user nova-compute[74882]:   <features>
Nov 21 14:17:38 user nova-compute[74882]:     <acpi/>
Nov 21 14:17:38 user nova-compute[74882]:     <apic/>
Nov 21 14:17:38 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:17:38 user nova-compute[74882]:   </features>
Nov 21 14:17:38 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:17:38 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:17:38 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:17:38 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:17:38 user nova-compute[74882]:   </clock>
Nov 21 14:17:38 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:17:38 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:17:38 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:17:38 user nova-compute[74882]:   </cpu>
Nov 21 14:17:38 user nova-compute[74882]:   <devices>
Nov 21 14:17:38 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:17:38 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:17:38 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk"/>
Nov 21 14:17:38 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:17:38 user nova-compute[74882]:     </disk>
Nov 21 14:17:38 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:17:38 user nova-compute[74882]:       <mac address="fa:16:3e:e8:d1:6f"/>
Nov 21 14:17:38 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:38 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:17:38 user nova-compute[74882]:       <target dev="tapf173e853-6e"/>
Nov 21 14:17:38 user nova-compute[74882]:     </interface>
Nov 21 14:17:38 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:17:38 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/console.log" append="off"/>
Nov 21 14:17:38 user nova-compute[74882]:     </serial>
Nov 21 14:17:38 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:17:38 user nova-compute[74882]:     <video>
Nov 21 14:17:38 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:38 user nova-compute[74882]:     </video>
Nov 21 14:17:38 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:17:38 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:17:38 user nova-compute[74882]:     </rng>
Nov 21 14:17:38 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:17:38 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:17:38 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:17:38 user nova-compute[74882]:     </memballoon>
Nov 21 14:17:38 user nova-compute[74882]:   </devices>
Nov 21 14:17:38 user nova-compute[74882]: </domain>
Nov 21 14:17:38 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-716976770',display_name='tempest-ServersNegativeTestJSON-server-716976770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-716976770',id=2,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8612dc478d4a40babe74b1fbf45eac93',ramdisk_id='',reservation_id='r-01ejk0kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1655313892',owner_user_name='tempest-ServersNegativeTestJSON-1655313892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:32Z,user_data=None,user_id='ec7d58eda515420f8b815338d2efd377',uuid=ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converting VIF {"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d1:6f,bridge_name='br-int',has_traffic_filtering=True,id=f173e853-6ea8-452e-8db2-e8a975c2f5df,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf173e853-6e') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG os_vif [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d1:6f,bridge_name='br-int',has_traffic_filtering=True,id=f173e853-6ea8-452e-8db2-e8a975c2f5df,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf173e853-6e') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbf93d8f-8325-5559-9544-290fd0b4ca57', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf173e853-6e, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf173e853-6e, col_values=(('qos', UUID('e7e75be8-d64a-4447-9f6e-415fc2651816')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf173e853-6e, col_values=(('external_ids', {'iface-id': 'f173e853-6ea8-452e-8db2-e8a975c2f5df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:d1:6f', 'vm-uuid': 'ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:38 user nova-compute[74882]: INFO os_vif [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:d1:6f,bridge_name='br-int',has_traffic_filtering=True,id=f173e853-6ea8-452e-8db2-e8a975c2f5df,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf173e853-6e')
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] No VIF found with MAC fa:16:3e:e8:d1:6f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:17:38 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Instance spawned successfully.
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:38 user nova-compute[74882]: INFO nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Took 10.50 seconds to spawn the instance on the hypervisor.
Nov 21 14:17:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:17:39 user nova-compute[74882]: INFO nova.compute.manager [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Took 11.45 seconds to build instance.
Nov 21 14:17:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d249de6b-2270-432a-be25-1c9eb152c98a tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.661s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG nova.network.neutron [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updated VIF entry in instance network info cache for port f173e853-6ea8-452e-8db2-e8a975c2f5df. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG nova.network.neutron [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updating instance_info_cache with network_info: [{"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1f88706-811c-4473-9de3-83182e0d2acb req-8c026c13-4723-4ffd-ad70-a2a0901abfa6 service nova] Releasing lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:17:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:40 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:17:40 user nova-compute[74882]: INFO nova.compute.claims [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Claim successful on node user
Nov 21 14:17:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.045s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:17:41 user nova-compute[74882]: INFO nova.compute.claims [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Claim successful on node user
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:17:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:17:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Creating image(s)
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "/opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.policy [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.285s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.policy [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.296s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:17:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Creating image(s)
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "/opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "/opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk 1073741824" returned: 0 in 0.077s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:17:42 user nova-compute[74882]: INFO nova.compute.claims [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Claim successful on node user
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.237s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.265s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Instance spawned successfully.
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Cannot resize image /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Ensure instance console log exists: /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:43 user nova-compute[74882]: INFO nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Took 10.86 seconds to spawn the instance on the hypervisor.
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.306s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk 1073741824" returned: 0 in 0.103s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.420s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:17:43 user nova-compute[74882]: INFO nova.compute.manager [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Took 12.10 seconds to build instance.
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a9232521-19c2-48cf-9ed8-4b6cac474abb tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.294s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.240s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:17:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Cannot resize image /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Ensure instance console log exists: /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:17:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Creating image(s)
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.059s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.255s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG nova.policy [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.283s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Successfully created port: c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk 1073741824" returned: 0 in 0.067s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.245s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:17:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Cannot resize image /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Ensure instance console log exists: /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG nova.network.neutron [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Successfully created port: a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Successfully updated port: c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquired lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-changed-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Refreshing instance network info cache due to event network-changed-c0cf7d6d-fa0c-42c8-b031-069446ad2314. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Acquiring lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:17:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updating instance_info_cache with network_info: [{"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Releasing lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Instance network_info: |[{"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Acquired lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Refreshing network info cache for port c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Start _get_guest_xml network_info=[{"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:17:47 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:47 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-430908517',display_name='tempest-AttachVolumeNegativeTest-server-430908517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-430908517',id=3,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwY//FreJ5qDC5lWo3bwL5cUVIrBloEThhGKinIL+Dcf3C1HRYL3HegVVTngLnHoOvc8ShLJ5l6nAqbLePxabslB+xeTUT15JkeNlYIhWq4vIcEL9qSUPo7AAdHWi+/Ag==',key_name='tempest-keypair-505302143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-vo99i1x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=f657a1d0-b67a-4cd6-ba3c-b801abedd8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:e6:25,bridge_name='br-int',has_traffic_filtering=True,id=c0cf7d6d-fa0c-42c8-b031-069446ad2314,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf7d6d-fa') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'pci_devices' on Instance uuid f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:17:47 user nova-compute[74882]:   <uuid>f657a1d0-b67a-4cd6-ba3c-b801abedd8ee</uuid>
Nov 21 14:17:47 user nova-compute[74882]:   <name>instance-00000003</name>
Nov 21 14:17:47 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:17:47 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:17:47 user nova-compute[74882]:   <metadata>
Nov 21 14:17:47 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:17:47 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:17:47 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeNegativeTest-server-430908517</nova:name>
Nov 21 14:17:47 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:17:47</nova:creationTime>
Nov 21 14:17:47 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:17:47 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:17:47 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:17:47 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:17:47 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:17:47 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:17:47 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:17:47 user nova-compute[74882]:       <nova:owner>
Nov 21 14:17:47 user nova-compute[74882]:         <nova:user uuid="d55abe8426b34d10b31ff6b0aefddd37">tempest-AttachVolumeNegativeTest-1777808809-project-member</nova:user>
Nov 21 14:17:47 user nova-compute[74882]:         <nova:project uuid="dadaa9830cd54eb09daee40d952be38f">tempest-AttachVolumeNegativeTest-1777808809</nova:project>
Nov 21 14:17:47 user nova-compute[74882]:       </nova:owner>
Nov 21 14:17:47 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:17:47 user nova-compute[74882]:       <nova:ports>
Nov 21 14:17:47 user nova-compute[74882]:         <nova:port uuid="c0cf7d6d-fa0c-42c8-b031-069446ad2314">
Nov 21 14:17:47 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 14:17:47 user nova-compute[74882]:         </nova:port>
Nov 21 14:17:47 user nova-compute[74882]:       </nova:ports>
Nov 21 14:17:47 user nova-compute[74882]:     </nova:instance>
Nov 21 14:17:47 user nova-compute[74882]:   </metadata>
Nov 21 14:17:47 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:17:47 user nova-compute[74882]:     <system>
Nov 21 14:17:47 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:17:47 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:17:47 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:17:47 user nova-compute[74882]:       <entry name="serial">f657a1d0-b67a-4cd6-ba3c-b801abedd8ee</entry>
Nov 21 14:17:47 user nova-compute[74882]:       <entry name="uuid">f657a1d0-b67a-4cd6-ba3c-b801abedd8ee</entry>
Nov 21 14:17:47 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:17:47 user nova-compute[74882]:     </system>
Nov 21 14:17:47 user nova-compute[74882]:   </sysinfo>
Nov 21 14:17:47 user nova-compute[74882]:   <os>
Nov 21 14:17:47 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:17:47 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:17:47 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:17:47 user nova-compute[74882]:   </os>
Nov 21 14:17:47 user nova-compute[74882]:   <features>
Nov 21 14:17:47 user nova-compute[74882]:     <acpi/>
Nov 21 14:17:47 user nova-compute[74882]:     <apic/>
Nov 21 14:17:47 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:17:47 user nova-compute[74882]:   </features>
Nov 21 14:17:47 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:17:47 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:17:47 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:17:47 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:17:47 user nova-compute[74882]:   </clock>
Nov 21 14:17:47 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:17:47 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:17:47 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:17:47 user nova-compute[74882]:   </cpu>
Nov 21 14:17:47 user nova-compute[74882]:   <devices>
Nov 21 14:17:47 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:17:47 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:17:47 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk"/>
Nov 21 14:17:47 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:17:47 user nova-compute[74882]:     </disk>
Nov 21 14:17:47 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:17:47 user nova-compute[74882]:       <mac address="fa:16:3e:47:e6:25"/>
Nov 21 14:17:47 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:47 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:17:47 user nova-compute[74882]:       <target dev="tapc0cf7d6d-fa"/>
Nov 21 14:17:47 user nova-compute[74882]:     </interface>
Nov 21 14:17:47 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:17:47 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/console.log" append="off"/>
Nov 21 14:17:47 user nova-compute[74882]:     </serial>
Nov 21 14:17:47 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:17:47 user nova-compute[74882]:     <video>
Nov 21 14:17:47 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:47 user nova-compute[74882]:     </video>
Nov 21 14:17:47 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:17:47 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:17:47 user nova-compute[74882]:     </rng>
Nov 21 14:17:47 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:17:47 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:17:47 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:17:47 user nova-compute[74882]:     </memballoon>
Nov 21 14:17:47 user nova-compute[74882]:   </devices>
Nov 21 14:17:47 user nova-compute[74882]: </domain>
Nov 21 14:17:47 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-430908517',display_name='tempest-AttachVolumeNegativeTest-server-430908517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-430908517',id=3,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwY//FreJ5qDC5lWo3bwL5cUVIrBloEThhGKinIL+Dcf3C1HRYL3HegVVTngLnHoOvc8ShLJ5l6nAqbLePxabslB+xeTUT15JkeNlYIhWq4vIcEL9qSUPo7AAdHWi+/Ag==',key_name='tempest-keypair-505302143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-vo99i1x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=f657a1d0-b67a-4cd6-ba3c-b801abedd8ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:e6:25,bridge_name='br-int',has_traffic_filtering=True,id=c0cf7d6d-fa0c-42c8-b031-069446ad2314,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf7d6d-fa') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG os_vif [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e6:25,bridge_name='br-int',has_traffic_filtering=True,id=c0cf7d6d-fa0c-42c8-b031-069446ad2314,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf7d6d-fa') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7df51fbc-a450-5fd2-aef1-78db347749a4', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0cf7d6d-fa, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0cf7d6d-fa, col_values=(('qos', UUID('e55f60de-2fca-4f2d-977b-d719375fd94a')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0cf7d6d-fa, col_values=(('external_ids', {'iface-id': 'c0cf7d6d-fa0c-42c8-b031-069446ad2314', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:e6:25', 'vm-uuid': 'f657a1d0-b67a-4cd6-ba3c-b801abedd8ee'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:47 user nova-compute[74882]: INFO os_vif [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e6:25,bridge_name='br-int',has_traffic_filtering=True,id=c0cf7d6d-fa0c-42c8-b031-069446ad2314,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf7d6d-fa')
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No VIF found with MAC fa:16:3e:47:e6:25, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updated VIF entry in instance network info cache for port c0cf7d6d-fa0c-42c8-b031-069446ad2314. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updating instance_info_cache with network_info: [{"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7c2a1acb-37d6-43a3-ac51-b528041a7495 req-b6cc6467-8bdd-4369-bfc9-db2512133552 service nova] Releasing lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Successfully created port: f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:17:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Successfully updated port: a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquired lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-changed-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Refreshing instance network info cache due to event network-changed-a2969955-0235-4311-83c4-3d30b0e2ac53. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Acquiring lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:17:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Releasing lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Instance network_info: |[{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Acquired lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Refreshing network info cache for port a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Start _get_guest_xml network_info=[{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:17:51 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:51 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-30554362',display_name='tempest-ServerActionsTestOtherA-server-30554362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-30554362',id=4,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-yi860eg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=cdeb200f-cb4f-4916-8fef-b35ff231d033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b4:09,bridge_name='br-int',has_traffic_filtering=True,id=a2969955-0235-4311-83c4-3d30b0e2ac53,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2969955-02') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.objects.instance [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'pci_devices' on Instance uuid cdeb200f-cb4f-4916-8fef-b35ff231d033 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:17:51 user nova-compute[74882]:   <uuid>cdeb200f-cb4f-4916-8fef-b35ff231d033</uuid>
Nov 21 14:17:51 user nova-compute[74882]:   <name>instance-00000004</name>
Nov 21 14:17:51 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:17:51 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:17:51 user nova-compute[74882]:   <metadata>
Nov 21 14:17:51 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:17:51 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:17:51 user nova-compute[74882]:       <nova:name>tempest-ServerActionsTestOtherA-server-30554362</nova:name>
Nov 21 14:17:51 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:17:51</nova:creationTime>
Nov 21 14:17:51 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:17:51 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:17:51 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:17:51 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:17:51 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:17:51 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:17:51 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:17:51 user nova-compute[74882]:       <nova:owner>
Nov 21 14:17:51 user nova-compute[74882]:         <nova:user uuid="d9f06e22265f45beb3760ea3b9338c25">tempest-ServerActionsTestOtherA-538546207-project-member</nova:user>
Nov 21 14:17:51 user nova-compute[74882]:         <nova:project uuid="079d8162d1ea42ddbf31668c8a44cf73">tempest-ServerActionsTestOtherA-538546207</nova:project>
Nov 21 14:17:51 user nova-compute[74882]:       </nova:owner>
Nov 21 14:17:51 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:17:51 user nova-compute[74882]:       <nova:ports>
Nov 21 14:17:51 user nova-compute[74882]:         <nova:port uuid="a2969955-0235-4311-83c4-3d30b0e2ac53">
Nov 21 14:17:51 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 14:17:51 user nova-compute[74882]:         </nova:port>
Nov 21 14:17:51 user nova-compute[74882]:       </nova:ports>
Nov 21 14:17:51 user nova-compute[74882]:     </nova:instance>
Nov 21 14:17:51 user nova-compute[74882]:   </metadata>
Nov 21 14:17:51 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:17:51 user nova-compute[74882]:     <system>
Nov 21 14:17:51 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:17:51 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:17:51 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:17:51 user nova-compute[74882]:       <entry name="serial">cdeb200f-cb4f-4916-8fef-b35ff231d033</entry>
Nov 21 14:17:51 user nova-compute[74882]:       <entry name="uuid">cdeb200f-cb4f-4916-8fef-b35ff231d033</entry>
Nov 21 14:17:51 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:17:51 user nova-compute[74882]:     </system>
Nov 21 14:17:51 user nova-compute[74882]:   </sysinfo>
Nov 21 14:17:51 user nova-compute[74882]:   <os>
Nov 21 14:17:51 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:17:51 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:17:51 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:17:51 user nova-compute[74882]:   </os>
Nov 21 14:17:51 user nova-compute[74882]:   <features>
Nov 21 14:17:51 user nova-compute[74882]:     <acpi/>
Nov 21 14:17:51 user nova-compute[74882]:     <apic/>
Nov 21 14:17:51 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:17:51 user nova-compute[74882]:   </features>
Nov 21 14:17:51 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:17:51 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:17:51 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:17:51 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:17:51 user nova-compute[74882]:   </clock>
Nov 21 14:17:51 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:17:51 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:17:51 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:17:51 user nova-compute[74882]:   </cpu>
Nov 21 14:17:51 user nova-compute[74882]:   <devices>
Nov 21 14:17:51 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:17:51 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:17:51 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk"/>
Nov 21 14:17:51 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:17:51 user nova-compute[74882]:     </disk>
Nov 21 14:17:51 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:17:51 user nova-compute[74882]:       <mac address="fa:16:3e:e4:b4:09"/>
Nov 21 14:17:51 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:51 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:17:51 user nova-compute[74882]:       <target dev="tapa2969955-02"/>
Nov 21 14:17:51 user nova-compute[74882]:     </interface>
Nov 21 14:17:51 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:17:51 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/console.log" append="off"/>
Nov 21 14:17:51 user nova-compute[74882]:     </serial>
Nov 21 14:17:51 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:17:51 user nova-compute[74882]:     <video>
Nov 21 14:17:51 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:51 user nova-compute[74882]:     </video>
Nov 21 14:17:51 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:17:51 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:17:51 user nova-compute[74882]:     </rng>
Nov 21 14:17:51 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:17:51 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:17:51 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:17:51 user nova-compute[74882]:     </memballoon>
Nov 21 14:17:51 user nova-compute[74882]:   </devices>
Nov 21 14:17:51 user nova-compute[74882]: </domain>
Nov 21 14:17:51 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-30554362',display_name='tempest-ServerActionsTestOtherA-server-30554362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-30554362',id=4,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-yi860eg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=cdeb200f-cb4f-4916-8fef-b35ff231d033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b4:09,bridge_name='br-int',has_traffic_filtering=True,id=a2969955-0235-4311-83c4-3d30b0e2ac53,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2969955-02') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG os_vif [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b4:09,bridge_name='br-int',has_traffic_filtering=True,id=a2969955-0235-4311-83c4-3d30b0e2ac53,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2969955-02') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46b8a566-58ff-5015-ad9f-9363c769718d', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2969955-02, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2969955-02, col_values=(('qos', UUID('3a1b93c7-a421-45c9-b334-93714fe59fc5')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2969955-02, col_values=(('external_ids', {'iface-id': 'a2969955-0235-4311-83c4-3d30b0e2ac53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:b4:09', 'vm-uuid': 'cdeb200f-cb4f-4916-8fef-b35ff231d033'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:51 user nova-compute[74882]: INFO os_vif [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b4:09,bridge_name='br-int',has_traffic_filtering=True,id=a2969955-0235-4311-83c4-3d30b0e2ac53,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2969955-02')
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No VIF found with MAC fa:16:3e:e4:b4:09, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:17:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Instance spawned successfully.
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Successfully updated port: f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:17:51 user nova-compute[74882]: INFO nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Took 10.07 seconds to spawn the instance on the hypervisor.
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquired lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:17:52 user nova-compute[74882]: INFO nova.compute.manager [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Took 11.17 seconds to build instance.
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-changed-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Refreshing instance network info cache due to event network-changed-f39421d4-14c9-470b-9aab-7c4b25deccd2. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Acquiring lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c2b9ca41-3d6a-4189-bd47-b6e088a91dd5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.550s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.neutron [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updated VIF entry in instance network info cache for port a2969955-0235-4311-83c4-3d30b0e2ac53. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.neutron [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fc48c5b3-cd27-4501-9c0e-0edfb36c54fd req-da368612-bb43-4ec6-bdb3-910a2e20be88 service nova] Releasing lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Releasing lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance network_info: |[{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Acquired lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.neutron [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Refreshing network info cache for port f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Start _get_guest_xml network_info=[{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:17:52 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:52 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.objects.instance [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'pci_devices' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:17:52 user nova-compute[74882]:   <uuid>7892830a-13fc-48a2-bfd3-29a96b2a9113</uuid>
Nov 21 14:17:52 user nova-compute[74882]:   <name>instance-00000005</name>
Nov 21 14:17:52 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:17:52 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:17:52 user nova-compute[74882]:   <metadata>
Nov 21 14:17:52 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:17:52 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:17:52 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeTestJSON-server-70492316</nova:name>
Nov 21 14:17:52 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:17:52</nova:creationTime>
Nov 21 14:17:52 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:17:52 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:17:52 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:17:52 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:17:52 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:17:52 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:17:52 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:17:52 user nova-compute[74882]:       <nova:owner>
Nov 21 14:17:52 user nova-compute[74882]:         <nova:user uuid="c0cb90d4bdf74f9390124833ea8331bd">tempest-AttachVolumeTestJSON-1610644153-project-member</nova:user>
Nov 21 14:17:52 user nova-compute[74882]:         <nova:project uuid="894802e2e3d044199467be931dd8e036">tempest-AttachVolumeTestJSON-1610644153</nova:project>
Nov 21 14:17:52 user nova-compute[74882]:       </nova:owner>
Nov 21 14:17:52 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:17:52 user nova-compute[74882]:       <nova:ports>
Nov 21 14:17:52 user nova-compute[74882]:         <nova:port uuid="f39421d4-14c9-470b-9aab-7c4b25deccd2">
Nov 21 14:17:52 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 21 14:17:52 user nova-compute[74882]:         </nova:port>
Nov 21 14:17:52 user nova-compute[74882]:       </nova:ports>
Nov 21 14:17:52 user nova-compute[74882]:     </nova:instance>
Nov 21 14:17:52 user nova-compute[74882]:   </metadata>
Nov 21 14:17:52 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:17:52 user nova-compute[74882]:     <system>
Nov 21 14:17:52 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:17:52 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:17:52 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:17:52 user nova-compute[74882]:       <entry name="serial">7892830a-13fc-48a2-bfd3-29a96b2a9113</entry>
Nov 21 14:17:52 user nova-compute[74882]:       <entry name="uuid">7892830a-13fc-48a2-bfd3-29a96b2a9113</entry>
Nov 21 14:17:52 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:17:52 user nova-compute[74882]:     </system>
Nov 21 14:17:52 user nova-compute[74882]:   </sysinfo>
Nov 21 14:17:52 user nova-compute[74882]:   <os>
Nov 21 14:17:52 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:17:52 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:17:52 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:17:52 user nova-compute[74882]:   </os>
Nov 21 14:17:52 user nova-compute[74882]:   <features>
Nov 21 14:17:52 user nova-compute[74882]:     <acpi/>
Nov 21 14:17:52 user nova-compute[74882]:     <apic/>
Nov 21 14:17:52 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:17:52 user nova-compute[74882]:   </features>
Nov 21 14:17:52 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:17:52 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:17:52 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:17:52 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:17:52 user nova-compute[74882]:   </clock>
Nov 21 14:17:52 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:17:52 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:17:52 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:17:52 user nova-compute[74882]:   </cpu>
Nov 21 14:17:52 user nova-compute[74882]:   <devices>
Nov 21 14:17:52 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:17:52 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:17:52 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk"/>
Nov 21 14:17:52 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:17:52 user nova-compute[74882]:     </disk>
Nov 21 14:17:52 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:17:52 user nova-compute[74882]:       <mac address="fa:16:3e:5c:a6:7f"/>
Nov 21 14:17:52 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:52 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:17:52 user nova-compute[74882]:       <target dev="tapf39421d4-14"/>
Nov 21 14:17:52 user nova-compute[74882]:     </interface>
Nov 21 14:17:52 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:17:52 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/console.log" append="off"/>
Nov 21 14:17:52 user nova-compute[74882]:     </serial>
Nov 21 14:17:52 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:17:52 user nova-compute[74882]:     <video>
Nov 21 14:17:52 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:17:52 user nova-compute[74882]:     </video>
Nov 21 14:17:52 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:17:52 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:17:52 user nova-compute[74882]:     </rng>
Nov 21 14:17:52 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:17:52 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:17:52 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:17:52 user nova-compute[74882]:     </memballoon>
Nov 21 14:17:52 user nova-compute[74882]:   </devices>
Nov 21 14:17:52 user nova-compute[74882]: </domain>
Nov 21 14:17:52 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG os_vif [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19d5e82a-b4b2-51a0-a994-4278e9a69e26', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf39421d4-14, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf39421d4-14, col_values=(('qos', UUID('568bb40d-4219-4daf-a2ec-7c3933e76d9e')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf39421d4-14, col_values=(('external_ids', {'iface-id': 'f39421d4-14c9-470b-9aab-7c4b25deccd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:a6:7f', 'vm-uuid': '7892830a-13fc-48a2-bfd3-29a96b2a9113'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:17:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:52 user nova-compute[74882]: INFO os_vif [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14')
Nov 21 14:17:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No VIF found with MAC fa:16:3e:5c:a6:7f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG nova.network.neutron [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updated VIF entry in instance network info cache for port f39421d4-14c9-470b-9aab-7c4b25deccd2. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG nova.network.neutron [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:17:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d0b4b0ec-3b15-4363-be9a-fe974f23089b req-9c4e2fe7-f764-4679-bf46-bc0c821ef24c service nova] Releasing lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:17:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:17:57 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Instance spawned successfully.
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:57 user nova-compute[74882]: INFO nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Took 15.19 seconds to spawn the instance on the hypervisor.
Nov 21 14:17:57 user nova-compute[74882]: DEBUG nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:17:57 user nova-compute[74882]: INFO nova.compute.manager [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Took 16.59 seconds to build instance.
Nov 21 14:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-74314a98-4539-429a-b56b-22ef93c5dfa8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.862s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:17:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance spawned successfully.
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:17:58 user nova-compute[74882]: INFO nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Took 14.48 seconds to spawn the instance on the hypervisor.
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received event network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] No waiting events found dispatching network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:17:58 user nova-compute[74882]: WARNING nova.compute.manager [req-f989fe51-f011-4664-9763-57e600e3bc70 req-f1b37509-3038-415b-a591-1d8f71d76cda service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received unexpected event network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 for instance with vm_state active and task_state None.
Nov 21 14:17:58 user nova-compute[74882]: INFO nova.compute.manager [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Took 15.98 seconds to build instance.
Nov 21 14:17:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-222e5bce-158f-4747-9f06-7f1c5a27cbc2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.406s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:17:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:17:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:17:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:17:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:18:00 user nova-compute[74882]: INFO nova.compute.claims [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Claim successful on node user
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received event network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] No waiting events found dispatching network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:00 user nova-compute[74882]: WARNING nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received unexpected event network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 for instance with vm_state active and task_state None.
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received event network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] No waiting events found dispatching network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:00 user nova-compute[74882]: WARNING nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received unexpected event network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df for instance with vm_state active and task_state None.
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received event network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] No waiting events found dispatching network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:00 user nova-compute[74882]: WARNING nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received unexpected event network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df for instance with vm_state active and task_state None.
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] No waiting events found dispatching network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:00 user nova-compute[74882]: WARNING nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received unexpected event network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance with vm_state active and task_state None.
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] No waiting events found dispatching network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:00 user nova-compute[74882]: WARNING nova.compute.manager [req-fde28e62-1682-426f-b441-d598fe98f060 req-86b211ca-b69c-43f7-9722-dc6418cda03a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received unexpected event network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance with vm_state active and task_state None.
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.825s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:18:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:18:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.policy [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9144e297f5b43a181844d967adcebae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7c11f81daa43449a6e96e3a20aa06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:18:01 user nova-compute[74882]: INFO nova.compute.claims [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Claim successful on node user
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:18:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Creating image(s)
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "/opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "/opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "/opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.247s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.216s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk 1073741824" returned: 0 in 0.069s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Successfully created port: 090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.860s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.network.neutron [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:18:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.217s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:18:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Creating image(s)
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "/opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "/opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "/opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "2902fcb19058ba65ad121ac34b8042865010877e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "2902fcb19058ba65ad121ac34b8042865010877e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Cannot resize image /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Ensure instance console log exists: /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:02 user nova-compute[74882]: DEBUG nova.policy [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9642feeb69a74dec89b9123a2afb4bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff93a19129c54087a14dde51cdd7b4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.part --force-share --output=json" returned: 0 in 0.295s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG nova.virt.images [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 390b3cc6-3bd3-4725-8892-588039943890 was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.part /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.part /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.converted" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "2902fcb19058ba65ad121ac34b8042865010877e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.400s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "2902fcb19058ba65ad121ac34b8042865010877e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "2902fcb19058ba65ad121ac34b8042865010877e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e --force-share --output=json" returned: 0 in 0.319s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e,backing_fmt=raw /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e,backing_fmt=raw /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk 1073741824" returned: 0 in 0.085s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "2902fcb19058ba65ad121ac34b8042865010877e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.411s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Successfully updated port: 090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquired lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-changed-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Refreshing instance network info cache due to event network-changed-090c076d-0081-4d00-9cb0-a8e9967622ad. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Acquiring lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e --force-share --output=json" returned: 0 in 0.286s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:18:04 user nova-compute[74882]: INFO nova.compute.claims [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Claim successful on node user
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Successfully created port: a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Cannot resize image /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Ensure instance console log exists: /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Updating instance_info_cache with network_info: [{"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Releasing lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Instance network_info: |[{"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Acquired lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.network.neutron [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Refreshing network info cache for port 090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Start _get_guest_xml network_info=[{"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:18:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-913422417',display_name='tempest-TestVolumeSwap-server-913422417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-913422417',id=6,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDJcP9bpfqyVfwqPqOZyspaUE/J2iSeVHMJqrkSft/En7JrwcVC3zqiSI5oD9SXW88j/ds3f/l+tqb3Zp3UNXzjHvRgqaH1GU8gFw+zAqyYFNe7nwZO6YW1S7+oCrcVpw==',key_name='tempest-keypair-1966473581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b7c11f81daa43449a6e96e3a20aa06e',ramdisk_id='',reservation_id='r-mlrrhrlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1148565282',owner_user_name='tempest-TestVolumeSwap-1148565282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9144e297f5b43a181844d967adcebae',uuid=b33785fd-01ad-4d08-9b66-f664b7440b1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Converting VIF {"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:5d:47,bridge_name='br-int',has_traffic_filtering=True,id=090c076d-0081-4d00-9cb0-a8e9967622ad,network=Network(ba264b79-eb59-49d9-b15a-8a7aea9d0d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c076d-00') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lazy-loading 'pci_devices' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:18:05 user nova-compute[74882]:   <uuid>b33785fd-01ad-4d08-9b66-f664b7440b1a</uuid>
Nov 21 14:18:05 user nova-compute[74882]:   <name>instance-00000006</name>
Nov 21 14:18:05 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:18:05 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:18:05 user nova-compute[74882]:   <metadata>
Nov 21 14:18:05 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:18:05 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:18:05 user nova-compute[74882]:       <nova:name>tempest-TestVolumeSwap-server-913422417</nova:name>
Nov 21 14:18:05 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:18:05</nova:creationTime>
Nov 21 14:18:05 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:18:05 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:18:05 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:18:05 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:18:05 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:18:05 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:18:05 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:18:05 user nova-compute[74882]:       <nova:owner>
Nov 21 14:18:05 user nova-compute[74882]:         <nova:user uuid="a9144e297f5b43a181844d967adcebae">tempest-TestVolumeSwap-1148565282-project-member</nova:user>
Nov 21 14:18:05 user nova-compute[74882]:         <nova:project uuid="4b7c11f81daa43449a6e96e3a20aa06e">tempest-TestVolumeSwap-1148565282</nova:project>
Nov 21 14:18:05 user nova-compute[74882]:       </nova:owner>
Nov 21 14:18:05 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:18:05 user nova-compute[74882]:       <nova:ports>
Nov 21 14:18:05 user nova-compute[74882]:         <nova:port uuid="090c076d-0081-4d00-9cb0-a8e9967622ad">
Nov 21 14:18:05 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 21 14:18:05 user nova-compute[74882]:         </nova:port>
Nov 21 14:18:05 user nova-compute[74882]:       </nova:ports>
Nov 21 14:18:05 user nova-compute[74882]:     </nova:instance>
Nov 21 14:18:05 user nova-compute[74882]:   </metadata>
Nov 21 14:18:05 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:18:05 user nova-compute[74882]:     <system>
Nov 21 14:18:05 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:18:05 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:18:05 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:18:05 user nova-compute[74882]:       <entry name="serial">b33785fd-01ad-4d08-9b66-f664b7440b1a</entry>
Nov 21 14:18:05 user nova-compute[74882]:       <entry name="uuid">b33785fd-01ad-4d08-9b66-f664b7440b1a</entry>
Nov 21 14:18:05 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:18:05 user nova-compute[74882]:     </system>
Nov 21 14:18:05 user nova-compute[74882]:   </sysinfo>
Nov 21 14:18:05 user nova-compute[74882]:   <os>
Nov 21 14:18:05 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:18:05 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:18:05 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:18:05 user nova-compute[74882]:   </os>
Nov 21 14:18:05 user nova-compute[74882]:   <features>
Nov 21 14:18:05 user nova-compute[74882]:     <acpi/>
Nov 21 14:18:05 user nova-compute[74882]:     <apic/>
Nov 21 14:18:05 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:18:05 user nova-compute[74882]:   </features>
Nov 21 14:18:05 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:18:05 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:18:05 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:18:05 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:18:05 user nova-compute[74882]:   </clock>
Nov 21 14:18:05 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:18:05 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:18:05 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:18:05 user nova-compute[74882]:   </cpu>
Nov 21 14:18:05 user nova-compute[74882]:   <devices>
Nov 21 14:18:05 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:18:05 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:18:05 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk"/>
Nov 21 14:18:05 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:18:05 user nova-compute[74882]:     </disk>
Nov 21 14:18:05 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:18:05 user nova-compute[74882]:       <mac address="fa:16:3e:59:5d:47"/>
Nov 21 14:18:05 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:05 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:18:05 user nova-compute[74882]:       <target dev="tap090c076d-00"/>
Nov 21 14:18:05 user nova-compute[74882]:     </interface>
Nov 21 14:18:05 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:18:05 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/console.log" append="off"/>
Nov 21 14:18:05 user nova-compute[74882]:     </serial>
Nov 21 14:18:05 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:18:05 user nova-compute[74882]:     <video>
Nov 21 14:18:05 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:05 user nova-compute[74882]:     </video>
Nov 21 14:18:05 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:18:05 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:18:05 user nova-compute[74882]:     </rng>
Nov 21 14:18:05 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:18:05 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:18:05 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:18:05 user nova-compute[74882]:     </memballoon>
Nov 21 14:18:05 user nova-compute[74882]:   </devices>
Nov 21 14:18:05 user nova-compute[74882]: </domain>
Nov 21 14:18:05 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-913422417',display_name='tempest-TestVolumeSwap-server-913422417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-913422417',id=6,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDJcP9bpfqyVfwqPqOZyspaUE/J2iSeVHMJqrkSft/En7JrwcVC3zqiSI5oD9SXW88j/ds3f/l+tqb3Zp3UNXzjHvRgqaH1GU8gFw+zAqyYFNe7nwZO6YW1S7+oCrcVpw==',key_name='tempest-keypair-1966473581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b7c11f81daa43449a6e96e3a20aa06e',ramdisk_id='',reservation_id='r-mlrrhrlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1148565282',owner_user_name='tempest-TestVolumeSwap-1148565282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9144e297f5b43a181844d967adcebae',uuid=b33785fd-01ad-4d08-9b66-f664b7440b1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Converting VIF {"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:5d:47,bridge_name='br-int',has_traffic_filtering=True,id=090c076d-0081-4d00-9cb0-a8e9967622ad,network=Network(ba264b79-eb59-49d9-b15a-8a7aea9d0d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c076d-00') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG os_vif [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:5d:47,bridge_name='br-int',has_traffic_filtering=True,id=090c076d-0081-4d00-9cb0-a8e9967622ad,network=Network(ba264b79-eb59-49d9-b15a-8a7aea9d0d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c076d-00') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16e92993-9a08-5dd5-847b-58376f534a85', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap090c076d-00, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap090c076d-00, col_values=(('qos', UUID('e96f187c-d13c-48ca-ae26-b6552139b10a')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap090c076d-00, col_values=(('external_ids', {'iface-id': '090c076d-0081-4d00-9cb0-a8e9967622ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:5d:47', 'vm-uuid': 'b33785fd-01ad-4d08-9b66-f664b7440b1a'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:05 user nova-compute[74882]: INFO os_vif [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:5d:47,bridge_name='br-int',has_traffic_filtering=True,id=090c076d-0081-4d00-9cb0-a8e9967622ad,network=Network(ba264b79-eb59-49d9-b15a-8a7aea9d0d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c076d-00')
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.161s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:18:05 user nova-compute[74882]: INFO nova.compute.claims [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Claim successful on node user
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.network.neutron [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] No VIF found with MAC fa:16:3e:59:5d:47, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:18:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.policy [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75ff0e0266134eb7abca050cf13030aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f462575fd893488d8e31ba67b58a1879', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:18:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Creating image(s)
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "/opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "/opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Successfully updated port: a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.252s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquired lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.network.neutron [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Updated VIF entry in instance network info cache for port 090c076d-0081-4d00-9cb0-a8e9967622ad. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.network.neutron [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Updating instance_info_cache with network_info: [{"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a1661b88-9d9f-4577-997b-8679a8465cbc req-e55f8245-3e22-4a92-bd8f-7591234e2841 service nova] Releasing lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.887s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.267s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk 1073741824" returned: 0 in 0.066s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-changed-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Refreshing instance network info cache due to event network-changed-a0b8b24e-ecbb-44f4-a461-da537be0c5d1. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Acquiring lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.policy [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.260s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:18:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Creating image(s)
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Successfully created port: a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Cannot resize image /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Ensure instance console log exists: /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.network.neutron [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updating instance_info_cache with network_info: [{"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.227s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Releasing lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Instance network_info: |[{"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Acquired lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.network.neutron [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Refreshing network info cache for port a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Start _get_guest_xml network_info=[{"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:17:51Z,direct_url=<?>,disk_format='qcow2',id=390b3cc6-3bd3-4725-8892-588039943890,min_disk=0,min_ram=0,name='',owner='0626c7e2e1b047ceadf84cb2b5fda262',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:17:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': '390b3cc6-3bd3-4725-8892-588039943890'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:18:07 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:07 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:17:51Z,direct_url=<?>,disk_format='qcow2',id=390b3cc6-3bd3-4725-8892-588039943890,min_disk=0,min_ram=0,name='',owner='0626c7e2e1b047ceadf84cb2b5fda262',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:17:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065534804',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065534804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065534804',id=7,image_ref='390b3cc6-3bd3-4725-8892-588039943890',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNovnpySsk3U0Q8+6LE0jiFBVTtkEvGsSDriJ5AOb/mzU9zamNWZhEW+zvPNYWK/cq/0aVIY6jPkY2qVS+L+dk7lkr/cLCQgfbWINSCyPIASxIiL1t7Y3W5GSsYQulzqMA==',key_name='tempest-keypair-2090548767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff93a19129c54087a14dde51cdd7b4dc',ramdisk_id='',reservation_id='r-j7fcny9l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='390b3cc6-3bd3-4725-8892-588039943890',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-140131820',owner_user_name='tempest-AttachSCSIVolumeTestJSON-140131820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9642feeb69a74dec89b9123a2afb4bba',uuid=aed46662-03d4-4005-967f-56759e6dbe02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Converting VIF {"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d0:99,bridge_name='br-int',has_traffic_filtering=True,id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1,network=Network(ac66118d-d7f7-4ea5-9867-17c6981992ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8b24e-ec') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.objects.instance [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lazy-loading 'pci_devices' on Instance uuid aed46662-03d4-4005-967f-56759e6dbe02 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:18:07 user nova-compute[74882]:   <uuid>aed46662-03d4-4005-967f-56759e6dbe02</uuid>
Nov 21 14:18:07 user nova-compute[74882]:   <name>instance-00000007</name>
Nov 21 14:18:07 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:18:07 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:18:07 user nova-compute[74882]:   <metadata>
Nov 21 14:18:07 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:18:07 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:18:07 user nova-compute[74882]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1065534804</nova:name>
Nov 21 14:18:07 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:18:07</nova:creationTime>
Nov 21 14:18:07 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:18:07 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:18:07 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:18:07 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:18:07 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:18:07 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:18:07 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:18:07 user nova-compute[74882]:       <nova:owner>
Nov 21 14:18:07 user nova-compute[74882]:         <nova:user uuid="9642feeb69a74dec89b9123a2afb4bba">tempest-AttachSCSIVolumeTestJSON-140131820-project-member</nova:user>
Nov 21 14:18:07 user nova-compute[74882]:         <nova:project uuid="ff93a19129c54087a14dde51cdd7b4dc">tempest-AttachSCSIVolumeTestJSON-140131820</nova:project>
Nov 21 14:18:07 user nova-compute[74882]:       </nova:owner>
Nov 21 14:18:07 user nova-compute[74882]:       <nova:root type="image" uuid="390b3cc6-3bd3-4725-8892-588039943890"/>
Nov 21 14:18:07 user nova-compute[74882]:       <nova:ports>
Nov 21 14:18:07 user nova-compute[74882]:         <nova:port uuid="a0b8b24e-ecbb-44f4-a461-da537be0c5d1">
Nov 21 14:18:07 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:18:07 user nova-compute[74882]:         </nova:port>
Nov 21 14:18:07 user nova-compute[74882]:       </nova:ports>
Nov 21 14:18:07 user nova-compute[74882]:     </nova:instance>
Nov 21 14:18:07 user nova-compute[74882]:   </metadata>
Nov 21 14:18:07 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:18:07 user nova-compute[74882]:     <system>
Nov 21 14:18:07 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:18:07 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:18:07 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:18:07 user nova-compute[74882]:       <entry name="serial">aed46662-03d4-4005-967f-56759e6dbe02</entry>
Nov 21 14:18:07 user nova-compute[74882]:       <entry name="uuid">aed46662-03d4-4005-967f-56759e6dbe02</entry>
Nov 21 14:18:07 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:18:07 user nova-compute[74882]:     </system>
Nov 21 14:18:07 user nova-compute[74882]:   </sysinfo>
Nov 21 14:18:07 user nova-compute[74882]:   <os>
Nov 21 14:18:07 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:18:07 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:18:07 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:18:07 user nova-compute[74882]:   </os>
Nov 21 14:18:07 user nova-compute[74882]:   <features>
Nov 21 14:18:07 user nova-compute[74882]:     <acpi/>
Nov 21 14:18:07 user nova-compute[74882]:     <apic/>
Nov 21 14:18:07 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:18:07 user nova-compute[74882]:   </features>
Nov 21 14:18:07 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:18:07 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:18:07 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:18:07 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:18:07 user nova-compute[74882]:   </clock>
Nov 21 14:18:07 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:18:07 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:18:07 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:18:07 user nova-compute[74882]:   </cpu>
Nov 21 14:18:07 user nova-compute[74882]:   <devices>
Nov 21 14:18:07 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:18:07 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:18:07 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk"/>
Nov 21 14:18:07 user nova-compute[74882]:       <target dev="sda" bus="scsi"/>
Nov 21 14:18:07 user nova-compute[74882]:       <address type="drive" controller="0" unit="0"/>
Nov 21 14:18:07 user nova-compute[74882]:     </disk>
Nov 21 14:18:07 user nova-compute[74882]:     <disk type="file" device="cdrom">
Nov 21 14:18:07 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none"/>
Nov 21 14:18:07 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk.config"/>
Nov 21 14:18:07 user nova-compute[74882]:       <target dev="sdb" bus="scsi"/>
Nov 21 14:18:07 user nova-compute[74882]:       <address type="drive" controller="0" unit="1"/>
Nov 21 14:18:07 user nova-compute[74882]:     </disk>
Nov 21 14:18:07 user nova-compute[74882]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 21 14:18:07 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:18:07 user nova-compute[74882]:       <mac address="fa:16:3e:75:d0:99"/>
Nov 21 14:18:07 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:07 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:18:07 user nova-compute[74882]:       <target dev="tapa0b8b24e-ec"/>
Nov 21 14:18:07 user nova-compute[74882]:     </interface>
Nov 21 14:18:07 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:18:07 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/console.log" append="off"/>
Nov 21 14:18:07 user nova-compute[74882]:     </serial>
Nov 21 14:18:07 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:18:07 user nova-compute[74882]:     <video>
Nov 21 14:18:07 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:07 user nova-compute[74882]:     </video>
Nov 21 14:18:07 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:18:07 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:18:07 user nova-compute[74882]:     </rng>
Nov 21 14:18:07 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:18:07 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:18:07 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:18:07 user nova-compute[74882]:     </memballoon>
Nov 21 14:18:07 user nova-compute[74882]:   </devices>
Nov 21 14:18:07 user nova-compute[74882]: </domain>
Nov 21 14:18:07 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065534804',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065534804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065534804',id=7,image_ref='390b3cc6-3bd3-4725-8892-588039943890',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNovnpySsk3U0Q8+6LE0jiFBVTtkEvGsSDriJ5AOb/mzU9zamNWZhEW+zvPNYWK/cq/0aVIY6jPkY2qVS+L+dk7lkr/cLCQgfbWINSCyPIASxIiL1t7Y3W5GSsYQulzqMA==',key_name='tempest-keypair-2090548767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff93a19129c54087a14dde51cdd7b4dc',ramdisk_id='',reservation_id='r-j7fcny9l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='390b3cc6-3bd3-4725-8892-588039943890',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-140131820',owner_user_name='tempest-AttachSCSIVolumeTestJSON-140131820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9642feeb69a74dec89b9123a2afb4bba',uuid=aed46662-03d4-4005-967f-56759e6dbe02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Converting VIF {"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d0:99,bridge_name='br-int',has_traffic_filtering=True,id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1,network=Network(ac66118d-d7f7-4ea5-9867-17c6981992ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8b24e-ec') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG os_vif [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d0:99,bridge_name='br-int',has_traffic_filtering=True,id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1,network=Network(ac66118d-d7f7-4ea5-9867-17c6981992ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8b24e-ec') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ae3fd78-2883-52d6-a85a-a08572e229ab', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0b8b24e-ec, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0b8b24e-ec, col_values=(('qos', UUID('c8b13bfe-0f7d-412a-912d-e8b7f572c0aa')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0b8b24e-ec, col_values=(('external_ids', {'iface-id': 'a0b8b24e-ecbb-44f4-a461-da537be0c5d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:d0:99', 'vm-uuid': 'aed46662-03d4-4005-967f-56759e6dbe02'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:07 user nova-compute[74882]: INFO os_vif [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d0:99,bridge_name='br-int',has_traffic_filtering=True,id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1,network=Network(ac66118d-d7f7-4ea5-9867-17c6981992ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8b24e-ec')
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.342s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk 1073741824" returned: 0 in 0.092s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.438s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] No BDM found with device name sda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] No VIF found with MAC fa:16:3e:75:d0:99, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:18:07 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Using config drive
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:07 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Creating config drive at /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk.config
Nov 21 14:18:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl2uwkyxb {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl2uwkyxb" returned: 0 in 0.082s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Cannot resize image /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Ensure instance console log exists: /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updated VIF entry in instance network info cache for port a0b8b24e-ecbb-44f4-a461-da537be0c5d1. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updating instance_info_cache with network_info: [{"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Successfully created port: eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Successfully updated port: a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25415b41-ea36-45f9-a5da-686d1a97816b req-4aa58bcb-4b95-4579-85db-e2ae7b8df791 service nova] Releasing lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquired lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-changed-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Refreshing instance network info cache due to event network-changed-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Acquiring lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Updating instance_info_cache with network_info: [{"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Releasing lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Instance network_info: |[{"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Acquired lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.neutron [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Refreshing network info cache for port a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Start _get_guest_xml network_info=[{"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:18:08 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:08 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1717958769',display_name='tempest-VolumesAssistedSnapshotsTest-server-1717958769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1717958769',id=8,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV8N4yxgVdRK01HFQutOwIthgXgkPWXkxVyqR+v6m5FqX2aGorRcylsw/cgdGD2IG97g8ccahhSe3hr9g6DETMsjzk7+mOHR15NMLkKTmEAGzpf8HO0/oLIlhzWj8oQMw==',key_name='tempest-keypair-973639123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462575fd893488d8e31ba67b58a1879',ramdisk_id='',reservation_id='r-bdzv4u47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-431845048',owner_user_name='tempest-VolumesAssistedSnapshotsTest-431845048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75ff0e0266134eb7abca050cf13030aa',uuid=6dfce4b7-6e4d-443a-96c1-ab0d11b553b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Converting VIF {"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:e6,bridge_name='br-int',has_traffic_filtering=True,id=a0ef15bf-19f8-4250-a6e0-989ee0bbccfa,network=Network(cc215826-b43e-4bbe-b2c6-d31fce3e0337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ef15bf-19') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.objects.instance [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:18:08 user nova-compute[74882]:   <uuid>6dfce4b7-6e4d-443a-96c1-ab0d11b553b2</uuid>
Nov 21 14:18:08 user nova-compute[74882]:   <name>instance-00000008</name>
Nov 21 14:18:08 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:18:08 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:18:08 user nova-compute[74882]:   <metadata>
Nov 21 14:18:08 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:18:08 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:18:08 user nova-compute[74882]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1717958769</nova:name>
Nov 21 14:18:08 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:18:08</nova:creationTime>
Nov 21 14:18:08 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:18:08 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:18:08 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:18:08 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:18:08 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:18:08 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:18:08 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:18:08 user nova-compute[74882]:       <nova:owner>
Nov 21 14:18:08 user nova-compute[74882]:         <nova:user uuid="75ff0e0266134eb7abca050cf13030aa">tempest-VolumesAssistedSnapshotsTest-431845048-project-member</nova:user>
Nov 21 14:18:08 user nova-compute[74882]:         <nova:project uuid="f462575fd893488d8e31ba67b58a1879">tempest-VolumesAssistedSnapshotsTest-431845048</nova:project>
Nov 21 14:18:08 user nova-compute[74882]:       </nova:owner>
Nov 21 14:18:08 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:18:08 user nova-compute[74882]:       <nova:ports>
Nov 21 14:18:08 user nova-compute[74882]:         <nova:port uuid="a0ef15bf-19f8-4250-a6e0-989ee0bbccfa">
Nov 21 14:18:08 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 21 14:18:08 user nova-compute[74882]:         </nova:port>
Nov 21 14:18:08 user nova-compute[74882]:       </nova:ports>
Nov 21 14:18:08 user nova-compute[74882]:     </nova:instance>
Nov 21 14:18:08 user nova-compute[74882]:   </metadata>
Nov 21 14:18:08 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:18:08 user nova-compute[74882]:     <system>
Nov 21 14:18:08 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:18:08 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:18:08 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:18:08 user nova-compute[74882]:       <entry name="serial">6dfce4b7-6e4d-443a-96c1-ab0d11b553b2</entry>
Nov 21 14:18:08 user nova-compute[74882]:       <entry name="uuid">6dfce4b7-6e4d-443a-96c1-ab0d11b553b2</entry>
Nov 21 14:18:08 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:18:08 user nova-compute[74882]:     </system>
Nov 21 14:18:08 user nova-compute[74882]:   </sysinfo>
Nov 21 14:18:08 user nova-compute[74882]:   <os>
Nov 21 14:18:08 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:18:08 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:18:08 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:18:08 user nova-compute[74882]:   </os>
Nov 21 14:18:08 user nova-compute[74882]:   <features>
Nov 21 14:18:08 user nova-compute[74882]:     <acpi/>
Nov 21 14:18:08 user nova-compute[74882]:     <apic/>
Nov 21 14:18:08 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:18:08 user nova-compute[74882]:   </features>
Nov 21 14:18:08 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:18:08 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:18:08 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:18:08 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:18:08 user nova-compute[74882]:   </clock>
Nov 21 14:18:08 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:18:08 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:18:08 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:18:08 user nova-compute[74882]:   </cpu>
Nov 21 14:18:08 user nova-compute[74882]:   <devices>
Nov 21 14:18:08 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:18:08 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:18:08 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk"/>
Nov 21 14:18:08 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:18:08 user nova-compute[74882]:     </disk>
Nov 21 14:18:08 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:18:08 user nova-compute[74882]:       <mac address="fa:16:3e:8e:09:e6"/>
Nov 21 14:18:08 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:08 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:18:08 user nova-compute[74882]:       <target dev="tapa0ef15bf-19"/>
Nov 21 14:18:08 user nova-compute[74882]:     </interface>
Nov 21 14:18:08 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:18:08 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/console.log" append="off"/>
Nov 21 14:18:08 user nova-compute[74882]:     </serial>
Nov 21 14:18:08 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:18:08 user nova-compute[74882]:     <video>
Nov 21 14:18:08 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:08 user nova-compute[74882]:     </video>
Nov 21 14:18:08 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:18:08 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:18:08 user nova-compute[74882]:     </rng>
Nov 21 14:18:08 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:18:08 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:18:08 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:18:08 user nova-compute[74882]:     </memballoon>
Nov 21 14:18:08 user nova-compute[74882]:   </devices>
Nov 21 14:18:08 user nova-compute[74882]: </domain>
Nov 21 14:18:08 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1717958769',display_name='tempest-VolumesAssistedSnapshotsTest-server-1717958769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1717958769',id=8,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV8N4yxgVdRK01HFQutOwIthgXgkPWXkxVyqR+v6m5FqX2aGorRcylsw/cgdGD2IG97g8ccahhSe3hr9g6DETMsjzk7+mOHR15NMLkKTmEAGzpf8HO0/oLIlhzWj8oQMw==',key_name='tempest-keypair-973639123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f462575fd893488d8e31ba67b58a1879',ramdisk_id='',reservation_id='r-bdzv4u47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-431845048',owner_user_name='tempest-VolumesAssistedSnapshotsTest-431845048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75ff0e0266134eb7abca050cf13030aa',uuid=6dfce4b7-6e4d-443a-96c1-ab0d11b553b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Converting VIF {"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:e6,bridge_name='br-int',has_traffic_filtering=True,id=a0ef15bf-19f8-4250-a6e0-989ee0bbccfa,network=Network(cc215826-b43e-4bbe-b2c6-d31fce3e0337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ef15bf-19') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG os_vif [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:e6,bridge_name='br-int',has_traffic_filtering=True,id=a0ef15bf-19f8-4250-a6e0-989ee0bbccfa,network=Network(cc215826-b43e-4bbe-b2c6-d31fce3e0337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ef15bf-19') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38e47233-02af-5c54-8050-dbd7e17a97ad', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0ef15bf-19, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0ef15bf-19, col_values=(('qos', UUID('f516be0e-4c9c-40bd-8a6b-eb657f1c1bf2')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0ef15bf-19, col_values=(('external_ids', {'iface-id': 'a0ef15bf-19f8-4250-a6e0-989ee0bbccfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:09:e6', 'vm-uuid': '6dfce4b7-6e4d-443a-96c1-ab0d11b553b2'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: INFO os_vif [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:09:e6,bridge_name='br-int',has_traffic_filtering=True,id=a0ef15bf-19f8-4250-a6e0-989ee0bbccfa,network=Network(cc215826-b43e-4bbe-b2c6-d31fce3e0337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ef15bf-19')
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Successfully updated port: eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] No VIF found with MAC fa:16:3e:8e:09:e6, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquired lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-changed-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Refreshing instance network info cache due to event network-changed-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Acquiring lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Updated VIF entry in instance network info cache for port a0ef15bf-19f8-4250-a6e0-989ee0bbccfa. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Updating instance_info_cache with network_info: [{"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8ede33ef-5136-41f1-b4a0-81f2ac602e9b req-4270e837-5123-41de-bd5a-e9eafc3b0db8 service nova] Releasing lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating instance_info_cache with network_info: [{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Releasing lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Instance network_info: |[{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Acquired lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Refreshing network info cache for port eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Start _get_guest_xml network_info=[{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:09 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1480492247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1480492247',id=9,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA==',key_name='tempest-keypair-733819265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1525a2b149ed40f9b3bbd98d1792a84c',ramdisk_id='',reservation_id='r-jjuy5qu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-607886265',owner_user_name='tempest-TaggedAttachmentsTest-607886265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0c9acb0c4a42beb3c41ba4ab44c4a8',uuid=4deaafad-f14d-4525-acaf-1ff5986f3db0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converting VIF {"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:61:c9,bridge_name='br-int',has_traffic_filtering=True,id=eba59df5-fece-4e7b-923c-3fd0f0a8c6cd,network=Network(e15ffa5f-4555-47e7-9a6b-827621cc2a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba59df5-fe') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.objects.instance [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'pci_devices' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:18:09 user nova-compute[74882]:   <uuid>4deaafad-f14d-4525-acaf-1ff5986f3db0</uuid>
Nov 21 14:18:09 user nova-compute[74882]:   <name>instance-00000009</name>
Nov 21 14:18:09 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:18:09 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:18:09 user nova-compute[74882]:   <metadata>
Nov 21 14:18:09 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:18:09 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:18:09 user nova-compute[74882]:       <nova:name>tempest-device-tagging-server-1480492247</nova:name>
Nov 21 14:18:09 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:18:09</nova:creationTime>
Nov 21 14:18:09 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:18:09 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:18:09 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:18:09 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:18:09 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:18:09 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:18:09 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:18:09 user nova-compute[74882]:       <nova:owner>
Nov 21 14:18:09 user nova-compute[74882]:         <nova:user uuid="ed0c9acb0c4a42beb3c41ba4ab44c4a8">tempest-TaggedAttachmentsTest-607886265-project-member</nova:user>
Nov 21 14:18:09 user nova-compute[74882]:         <nova:project uuid="1525a2b149ed40f9b3bbd98d1792a84c">tempest-TaggedAttachmentsTest-607886265</nova:project>
Nov 21 14:18:09 user nova-compute[74882]:       </nova:owner>
Nov 21 14:18:09 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:18:09 user nova-compute[74882]:       <nova:ports>
Nov 21 14:18:09 user nova-compute[74882]:         <nova:port uuid="eba59df5-fece-4e7b-923c-3fd0f0a8c6cd">
Nov 21 14:18:09 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:18:09 user nova-compute[74882]:         </nova:port>
Nov 21 14:18:09 user nova-compute[74882]:       </nova:ports>
Nov 21 14:18:09 user nova-compute[74882]:     </nova:instance>
Nov 21 14:18:09 user nova-compute[74882]:   </metadata>
Nov 21 14:18:09 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:18:09 user nova-compute[74882]:     <system>
Nov 21 14:18:09 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:18:09 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:18:09 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:18:09 user nova-compute[74882]:       <entry name="serial">4deaafad-f14d-4525-acaf-1ff5986f3db0</entry>
Nov 21 14:18:09 user nova-compute[74882]:       <entry name="uuid">4deaafad-f14d-4525-acaf-1ff5986f3db0</entry>
Nov 21 14:18:09 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:18:09 user nova-compute[74882]:     </system>
Nov 21 14:18:09 user nova-compute[74882]:   </sysinfo>
Nov 21 14:18:09 user nova-compute[74882]:   <os>
Nov 21 14:18:09 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:18:09 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:18:09 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:18:09 user nova-compute[74882]:   </os>
Nov 21 14:18:09 user nova-compute[74882]:   <features>
Nov 21 14:18:09 user nova-compute[74882]:     <acpi/>
Nov 21 14:18:09 user nova-compute[74882]:     <apic/>
Nov 21 14:18:09 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:18:09 user nova-compute[74882]:   </features>
Nov 21 14:18:09 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:18:09 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:18:09 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:18:09 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:18:09 user nova-compute[74882]:   </clock>
Nov 21 14:18:09 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:18:09 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:18:09 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:18:09 user nova-compute[74882]:   </cpu>
Nov 21 14:18:09 user nova-compute[74882]:   <devices>
Nov 21 14:18:09 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:18:09 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:18:09 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk"/>
Nov 21 14:18:09 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:18:09 user nova-compute[74882]:     </disk>
Nov 21 14:18:09 user nova-compute[74882]:     <disk type="file" device="cdrom">
Nov 21 14:18:09 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none"/>
Nov 21 14:18:09 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.config"/>
Nov 21 14:18:09 user nova-compute[74882]:       <target dev="hda" bus="ide"/>
Nov 21 14:18:09 user nova-compute[74882]:     </disk>
Nov 21 14:18:09 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:18:09 user nova-compute[74882]:       <mac address="fa:16:3e:38:61:c9"/>
Nov 21 14:18:09 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:09 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:18:09 user nova-compute[74882]:       <target dev="tapeba59df5-fe"/>
Nov 21 14:18:09 user nova-compute[74882]:     </interface>
Nov 21 14:18:09 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:18:09 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/console.log" append="off"/>
Nov 21 14:18:09 user nova-compute[74882]:     </serial>
Nov 21 14:18:09 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:18:09 user nova-compute[74882]:     <video>
Nov 21 14:18:09 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:18:09 user nova-compute[74882]:     </video>
Nov 21 14:18:09 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:18:09 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:18:09 user nova-compute[74882]:     </rng>
Nov 21 14:18:09 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:18:09 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:18:09 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:18:09 user nova-compute[74882]:     </memballoon>
Nov 21 14:18:09 user nova-compute[74882]:   </devices>
Nov 21 14:18:09 user nova-compute[74882]: </domain>
Nov 21 14:18:09 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1480492247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1480492247',id=9,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA==',key_name='tempest-keypair-733819265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1525a2b149ed40f9b3bbd98d1792a84c',ramdisk_id='',reservation_id='r-jjuy5qu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-607886265',owner_user_name='tempest-TaggedAttachmentsTest-607886265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0c9acb0c4a42beb3c41ba4ab44c4a8',uuid=4deaafad-f14d-4525-acaf-1ff5986f3db0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converting VIF {"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:61:c9,bridge_name='br-int',has_traffic_filtering=True,id=eba59df5-fece-4e7b-923c-3fd0f0a8c6cd,network=Network(e15ffa5f-4555-47e7-9a6b-827621cc2a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba59df5-fe') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG os_vif [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:61:c9,bridge_name='br-int',has_traffic_filtering=True,id=eba59df5-fece-4e7b-923c-3fd0f0a8c6cd,network=Network(e15ffa5f-4555-47e7-9a6b-827621cc2a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba59df5-fe') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16664a8d-9789-5072-aed3-80e39186a1dc', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeba59df5-fe, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeba59df5-fe, col_values=(('qos', UUID('f4d48961-d09e-453b-844e-ddc54d04098a')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeba59df5-fe, col_values=(('external_ids', {'iface-id': 'eba59df5-fece-4e7b-923c-3fd0f0a8c6cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:61:c9', 'vm-uuid': '4deaafad-f14d-4525-acaf-1ff5986f3db0'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:09 user nova-compute[74882]: INFO os_vif [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:61:c9,bridge_name='br-int',has_traffic_filtering=True,id=eba59df5-fece-4e7b-923c-3fd0f0a8c6cd,network=Network(e15ffa5f-4555-47e7-9a6b-827621cc2a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba59df5-fe')
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No BDM found with device name hda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:18:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No VIF found with MAC fa:16:3e:38:61:c9, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:18:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Using config drive
Nov 21 14:18:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Creating config drive at /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.config
Nov 21 14:18:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb616xd52 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb616xd52" returned: 0 in 0.074s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Instance spawned successfully.
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updated VIF entry in instance network info cache for port eba59df5-fece-4e7b-923c-3fd0f0a8c6cd. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating instance_info_cache with network_info: [{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5045279c-5d2f-4c12-8937-07324d563ff0 req-787d1da5-1f4f-47fb-9659-b29b32e9ce5d service nova] Releasing lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:10 user nova-compute[74882]: INFO nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Took 9.11 seconds to spawn the instance on the hypervisor.
Nov 21 14:18:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:10 user nova-compute[74882]: INFO nova.compute.manager [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Took 10.68 seconds to build instance.
Nov 21 14:18:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6042b4e1-1d52-46a5-bea2-e3ff8dc9fba9 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.904s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] No waiting events found dispatching network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:11 user nova-compute[74882]: WARNING nova.compute.manager [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received unexpected event network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad for instance with vm_state active and task_state None.
Nov 21 14:18:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] No waiting events found dispatching network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:11 user nova-compute[74882]: WARNING nova.compute.manager [req-591cecc3-59ae-44f9-9ac1-aebd4f258283 req-c33b542d-d4d3-40dc-9998-c5bec4608d37 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received unexpected event network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad for instance with vm_state active and task_state None.
Nov 21 14:18:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] No waiting events found dispatching network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:13 user nova-compute[74882]: WARNING nova.compute.manager [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received unexpected event network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance with vm_state building and task_state spawning.
Nov 21 14:18:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] No waiting events found dispatching network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:13 user nova-compute[74882]: WARNING nova.compute.manager [req-8f12f6d6-87c7-441c-9f1e-31c6ae64673e req-04ad3eaa-7feb-4aec-94b8-ceeeb1f60295 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received unexpected event network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance with vm_state building and task_state spawning.
Nov 21 14:18:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:18:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Instance spawned successfully.
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:15 user nova-compute[74882]: INFO nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Took 12.87 seconds to spawn the instance on the hypervisor.
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:18:15 user nova-compute[74882]: INFO nova.compute.manager [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Took 14.27 seconds to build instance.
Nov 21 14:18:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd7ffefd-d47b-4b3f-9e9e-66322fc3101c tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.414s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:15 user nova-compute[74882]: WARNING nova.compute.manager [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received unexpected event network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance with vm_state building and task_state spawning.
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:15 user nova-compute[74882]: WARNING nova.compute.manager [req-9a80af2b-cd43-4af2-a84f-ab4c59ba9b5a req-df518f00-8228-4a10-b9d3-164268347db5 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received unexpected event network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance with vm_state building and task_state spawning.
Nov 21 14:18:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:18:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Instance spawned successfully.
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: INFO nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Took 9.64 seconds to spawn the instance on the hypervisor.
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:18:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Instance spawned successfully.
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:18:16 user nova-compute[74882]: INFO nova.compute.manager [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Took 11.38 seconds to build instance.
Nov 21 14:18:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8e28a379-fa98-4dae-ae5b-d30a615029ba tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.658s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:16 user nova-compute[74882]: INFO nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Took 10.78 seconds to spawn the instance on the hypervisor.
Nov 21 14:18:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:18:16 user nova-compute[74882]: INFO nova.compute.manager [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Took 12.15 seconds to build instance.
Nov 21 14:18:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-005a176f-e136-4adf-9335-afbb0430babc tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.353s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:18:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:18:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:18:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:18:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] No waiting events found dispatching network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:26 user nova-compute[74882]: WARNING nova.compute.manager [req-86c662f7-7c3b-42f5-bca1-9cbda539d34e req-36890476-0665-4a65-bc36-fbe7b6e747c4 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received unexpected event network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 for instance with vm_state active and task_state None.
Nov 21 14:18:26 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:26 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:18:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7639MB free_disk=25.624473571777344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance b33785fd-01ad-4d08-9b66-f664b7440b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance aed46662-03d4-4005-967f-56759e6dbe02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:18:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] No waiting events found dispatching network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:28 user nova-compute[74882]: WARNING nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received unexpected event network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 for instance with vm_state active and task_state None.
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:28 user nova-compute[74882]: WARNING nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state active and task_state None.
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:28 user nova-compute[74882]: WARNING nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state active and task_state None.
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] No waiting events found dispatching network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:28 user nova-compute[74882]: WARNING nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received unexpected event network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance with vm_state active and task_state None.
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] No waiting events found dispatching network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:18:28 user nova-compute[74882]: WARNING nova.compute.manager [req-08a2a02d-df23-434d-ae71-07680d1b2c4d req-509f05c6-4d7a-4c6a-9380-cb1377ce27da service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received unexpected event network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance with vm_state active and task_state None.
Nov 21 14:18:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid c8f0dc3a-93fe-4de4-b362-1a71696277bf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:18:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updating instance_info_cache with network_info: [{"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-c8f0dc3a-93fe-4de4-b362-1a71696277bf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:18:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:18:43 user nova-compute[74882]: INFO nova.compute.claims [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Claim successful on node user
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:18:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:18:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:18:44 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:18:44 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:18:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:18:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:18:44 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:18:44 user nova-compute[74882]: INFO nova.virt.block_device [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Booting with volume 61b0d03a-6007-4a40-858a-33490851ad91 at /dev/vda
Nov 21 14:18:44 user nova-compute[74882]: DEBUG nova.policy [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80a5b85d5cdf4f8c9fb662c6e04b74fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e3715d8166472e843d6a046fc819c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:18:44 user nova-compute[74882]: DEBUG os_brick.utils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:18:44 user nova-compute[74882]: INFO oslo.privsep.daemon [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp0erkffw7/privsep.sock']
Nov 21 14:18:44 user sudo[85961]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp0erkffw7/privsep.sock
Nov 21 14:18:44 user sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 21 14:18:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully created port: 77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:45 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully created port: 33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:45 user sudo[85961]: pam_unix(sudo:session): session closed for user root
Nov 21 14:18:45 user nova-compute[74882]: INFO oslo.privsep.daemon [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Spawned new privsep daemon via rootwrap
Nov 21 14:18:45 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 21 14:18:45 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 21 14:18:45 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 21 14:18:45 user nova-compute[74882]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85964
Nov 21 14:18:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa92b245-1410-4a61-a4c9-c9491210fc05]: (2,) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully created port: a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[66761318-5e66-48a3-afe7-2e88cc9eb836]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:46 user nova-compute[74882]: WARNING os_brick.initiator.connectors.nvmeof [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8481edc7-5720-49e7-ba16-9a5951c8944d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b0b79e-c640-458d-969e-fe55ab789730]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc772d7-923e-4ec2-b42a-01a99dd2e8b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:18:46 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:18:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f472c3f4-1e5a-434a-a679-34de39e48f1d]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG os_brick.utils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== get_connector_properties: return (1940ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating existing volume attachment record: 24bdc424-8fc2-44c4-9199-211dc200e75d {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:18:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully created port: e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully created port: dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully updated port: 77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-77f1d830-ef25-47d5-a04a-76b7596eb24d. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port 77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:48 user nova-compute[74882]: DEBUG nova.network.neutron [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-936e8088-14b7-43f8-86db-5cafe5e37374 req-eba11be2-495b-441c-9074-996339edc629 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully updated port: 2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully updated port: 3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-2da6bd78-a4c0-4728-81e0-853c89c882fe. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG nova.network.neutron [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port 2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully updated port: 33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG nova.network.neutron [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-3bff0e3f-5977-4912-8998-ee250fc4ab87. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port 3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f21bb947-c4fe-49e4-ba67-2c1957126ba9 req-31e98f6a-60f5-4691-bd11-190aa6e5a904 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully updated port: a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-a39dce5a-2098-4347-82f4-a79edc2b3edf. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fce4ac91-de36-4381-a5c0-16d09fea9c9b req-904fe604-17a8-4296-8635-71006f0ed239 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully updated port: e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Successfully updated port: dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-33afd222-329a-46d7-81b1-f24247b83c00. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port 33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG nova.network.neutron [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-15e1a55c-6bce-4eb2-a7c6-edfe8ac2c80a req-2cf550fb-f7f2-4496-9dfd-b02e537de728 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-e4ad7de7-0f3a-4611-9aea-96d24957ab96. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:52 user nova-compute[74882]: INFO nova.virt.block_device [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Booting with volume 51ffdcef-a58a-4101-a967-2a66ec25ad93 at /dev/vdb
Nov 21 14:18:52 user nova-compute[74882]: DEBUG os_brick.utils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e1d72d-ac50-4d53-869e-f1d428bcf000]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7fd5ad-8405-4023-9354-585ff8f32863]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[05757a82-330f-4929-b70a-978d9dfcdf1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f411e540-5a49-4260-a810-72bcc8c65c66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:18:52 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:18:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91a800b-60a3-40ae-9616-054e69fb7575]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG os_brick.utils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:18:52 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating existing volume attachment record: e8183315-2adc-4d9a-8031-80736d2b9e80 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance network_info: |[{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.network.neutron [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.network.neutron [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updated VIF entry in instance network info cache for port e4ad7de7-0f3a-4611-9aea-96d24957ab96. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.network.neutron [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-dc19bf1d-6c50-486a-952c-3b3d067409f7. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.network.neutron [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.network.neutron [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updated VIF entry in instance network info cache for port dc19bf1d-6c50-486a-952c-3b3d067409f7. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG nova.network.neutron [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:18:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-294be916-c80f-48bd-8764-63b95ef847e2 req-12555d5b-c5b4-4490-b94c-5ae8d9229803 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:18:59 user nova-compute[74882]: INFO nova.virt.block_device [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Booting with volume edecdce9-a757-4671-8c6f-72b9d5048db1 at /dev/vdc
Nov 21 14:18:59 user nova-compute[74882]: DEBUG os_brick.utils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c90053-3ccf-40cf-b794-a8954d22efe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc1f81-dbf0-4235-839d-db86c83e2416]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0aac5a-f527-4c53-b22d-325cb295d7f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[33005185-46d7-4897-a7d8-1c1adecc0dc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:18:59 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:18:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcd9bc2-0ea3-4c57-aaec-b16210287f76]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG os_brick.utils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating existing volume attachment record: 927f303a-5fcf-4dda-ae92-b0f17127bdd9 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:18:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:19:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Creating image(s)
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Ensure instance console log exists: /opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Start _get_guest_xml network_info=[{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRKWPAMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e29b0dc-380b-42d1-a43d-048de2d2e57b', 'attached_at': '', 'detached_at': '', 'volume_id': '61b0d03a-6007-4a40-858a-33490851ad91', 'serial': '61b0d03a-6007-4a40-858a-33490851ad91'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '24bdc424-8fc2-44c4-9199-211dc200e75d', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcXLRMqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e29b0dc-380b-42d1-a43d-048de2d2e57b', 'attached_at': '', 'detached_at': '', 'volume_id': '51ffdcef-a58a-4101-a967-2a66ec25ad93', 'serial': '51ffdcef-a58a-4101-a967-2a66ec25ad93'}, 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'attachment_id': 'e8183315-2adc-4d9a-8031-80736d2b9e80', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARpTUqPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e29b0dc-380b-42d1-a43d-048de2d2e57b', 'attached_at': '', 'detached_at': '', 'volume_id': 'edecdce9-a757-4671-8c6f-72b9d5048db1', 'serial': 'edecdce9-a757-4671-8c6f-72b9d5048db1'}, 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'attachment_id': '927f303a-5fcf-4dda-ae92-b0f17127bdd9', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:19:06 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:06 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connector [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Factory for ISCSI on None {{(pid=74882) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRKWPAMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:06 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[da670124-dced-47bd-8d16-21e23776ecdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:19:06 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a132d2-3adf-4683-afc0-044b621d8f03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91] added
Nov 21 14:19:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b5785-1260-498c-a154-5af77b93fb55]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff70e1-f1d0-4e62-aa76-b94cf6c5cad6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRKWPAMI {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRKWPAMI" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07bce46-f225-449f-86e0-f5b7a5a31aa6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRKWPAMI'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f72a959-48aa-4475-af67-9a666832353e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[101ed533-e40a-4695-99bc-01c53c26853d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:19:06 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:19:06 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 14:19:06 user nova-compute[74882]: 
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3362f87a-ccf3-4b20-9f2f-c2e09f4f77dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260]
Nov 21 14:19:06 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260] successful.
Nov 21 14:19:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[147c1bfb-83d0-4407-9b12-be63d9006640]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b04b41f-367d-4b44-8cdc-eebd7aeacaaa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a81d9-0657-41d7-9a96-c84d0c1fe0ac]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRKWPAMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23063363162393063', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063363162393063', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcXLRMqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:07 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:07 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:07 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d734b1be-41d4-49d6-b704-c19cd4a9717d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:19:07 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17b1c85-eb09-4499-a152-0c3b0d87a71f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93] added
Nov 21 14:19:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a51e358-9959-4179-b8f2-dfb2ea2268f7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d700b-ac2d-47d1-bfe2-9fe262fd2e80]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcXLRMqf {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcXLRMqf" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa698e6-5ed6-4d64-8fd3-a2be1d0d5763]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BcXLRMqf'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[55019d6e-4232-4385-bc68-6c113bf92b9a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[08daae4c-c5a5-4bf4-9bd3-dfc7fd304ea6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9c77eb-ef4a-4d8b-bd08-297631847d13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260]
Nov 21 14:19:07 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260] successful.
Nov 21 14:19:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[20beae1b-8dad-4719-bfec-713221afc740]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a59fa-f688-463d-a507-68776641dd6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:07 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:07 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafc66f9-f7c6-43a1-a7bd-07588c18532a]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcXLRMqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26237326337373635', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237326337373635', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARpTUqPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:08 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:08 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:08 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e062af4-880e-492c-8718-a0354e7c23bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:19:08 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3988e180-38b4-48c4-b5fd-a9515d50d1d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1] added
Nov 21 14:19:08 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db1791-0a6a-4822-8e5d-6d83a00c0f81]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56aa2e1-5a4b-4aed-ba2b-abb87d010f38]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARpTUqPK {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARpTUqPK" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e54727-54bd-4740-a7f5-3eaa16cb8492]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ARpTUqPK'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d311000-87e6-448c-a962-6f3ac54599e8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdffb1b-2fde-4ad3-821a-864eca3ada4a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:08 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:08 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:08 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:08 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdb06e2-fa30-441b-adf9-dc7811d2628f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260]
Nov 21 14:19:08 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260] successful.
Nov 21 14:19:08 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72940b4-0fd4-47b3-89ce-bea5dcd2345f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca42bb-283e-46f3-8ad6-55b0f5434071]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:09 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:09 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:09 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:09 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[329a5275-fe01-4f76-8a5e-8853ba78d710]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARpTUqPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23364653962666161', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364653962666161', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:07:de,bridge_name='br-int',has_traffic_filtering=True,id=77f1d830-ef25-47d5-a04a-76b7596eb24d,network=Network(86bf0a81-542a-451d-8a26-2242103f9498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f1d830-ef') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9b:a0,bridge_name='br-int',has_traffic_filtering=True,id=2da6bd78-a4c0-4728-81e0-853c89c882fe,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2da6bd78-a4') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:35:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bff0e3f-5977-4912-8998-ee250fc4ab87,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bff0e3f-59') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:79:03,bridge_name='br-int',has_traffic_filtering=True,id=33afd222-329a-46d7-81b1-f24247b83c00,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33afd222-32') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e3:ef,bridge_name='br-int',has_traffic_filtering=True,id=a39dce5a-2098-4347-82f4-a79edc2b3edf,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39dce5a-20') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:26:42,bridge_name='br-int',has_traffic_filtering=True,id=e4ad7de7-0f3a-4611-9aea-96d24957ab96,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ad7de7-0f') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:64:1c,bridge_name='br-int',has_traffic_filtering=True,id=dc19bf1d-6c50-486a-952c-3b3d067409f7,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc19bf1d-6c') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.objects.instance [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e29b0dc-380b-42d1-a43d-048de2d2e57b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:19:10 user nova-compute[74882]:   <uuid>8e29b0dc-380b-42d1-a43d-048de2d2e57b</uuid>
Nov 21 14:19:10 user nova-compute[74882]:   <name>instance-0000000a</name>
Nov 21 14:19:10 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:19:10 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:19:10 user nova-compute[74882]:   <metadata>
Nov 21 14:19:10 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:19:10 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:19:10 user nova-compute[74882]:       <nova:name>tempest-device-tagging-server-43172401</nova:name>
Nov 21 14:19:10 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:19:06</nova:creationTime>
Nov 21 14:19:10 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:19:10 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:19:10 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:19:10 user nova-compute[74882]:       <nova:owner>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:user uuid="80a5b85d5cdf4f8c9fb662c6e04b74fb">tempest-TaggedBootDevicesTest_v242-613847140-project-member</nova:user>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:project uuid="76e3715d8166472e843d6a046fc819c6">tempest-TaggedBootDevicesTest_v242-613847140</nova:project>
Nov 21 14:19:10 user nova-compute[74882]:       </nova:owner>
Nov 21 14:19:10 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:19:10 user nova-compute[74882]:       <nova:ports>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:port uuid="77f1d830-ef25-47d5-a04a-76b7596eb24d">
Nov 21 14:19:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 21 14:19:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:port uuid="2da6bd78-a4c0-4728-81e0-853c89c882fe">
Nov 21 14:19:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 21 14:19:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:port uuid="3bff0e3f-5977-4912-8998-ee250fc4ab87">
Nov 21 14:19:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Nov 21 14:19:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:port uuid="33afd222-329a-46d7-81b1-f24247b83c00">
Nov 21 14:19:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Nov 21 14:19:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:port uuid="a39dce5a-2098-4347-82f4-a79edc2b3edf">
Nov 21 14:19:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Nov 21 14:19:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:port uuid="e4ad7de7-0f3a-4611-9aea-96d24957ab96">
Nov 21 14:19:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 21 14:19:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:10 user nova-compute[74882]:         <nova:port uuid="dc19bf1d-6c50-486a-952c-3b3d067409f7">
Nov 21 14:19:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 21 14:19:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:10 user nova-compute[74882]:       </nova:ports>
Nov 21 14:19:10 user nova-compute[74882]:     </nova:instance>
Nov 21 14:19:10 user nova-compute[74882]:   </metadata>
Nov 21 14:19:10 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:19:10 user nova-compute[74882]:     <system>
Nov 21 14:19:10 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:19:10 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:19:10 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:19:10 user nova-compute[74882]:       <entry name="serial">8e29b0dc-380b-42d1-a43d-048de2d2e57b</entry>
Nov 21 14:19:10 user nova-compute[74882]:       <entry name="uuid">8e29b0dc-380b-42d1-a43d-048de2d2e57b</entry>
Nov 21 14:19:10 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:19:10 user nova-compute[74882]:     </system>
Nov 21 14:19:10 user nova-compute[74882]:   </sysinfo>
Nov 21 14:19:10 user nova-compute[74882]:   <os>
Nov 21 14:19:10 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:19:10 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:19:10 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:19:10 user nova-compute[74882]:   </os>
Nov 21 14:19:10 user nova-compute[74882]:   <features>
Nov 21 14:19:10 user nova-compute[74882]:     <acpi/>
Nov 21 14:19:10 user nova-compute[74882]:     <apic/>
Nov 21 14:19:10 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:19:10 user nova-compute[74882]:   </features>
Nov 21 14:19:10 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:19:10 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:19:10 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:19:10 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:19:10 user nova-compute[74882]:   </clock>
Nov 21 14:19:10 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:19:10 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:19:10 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:19:10 user nova-compute[74882]:   </cpu>
Nov 21 14:19:10 user nova-compute[74882]:   <devices>
Nov 21 14:19:10 user nova-compute[74882]:     <disk type="file" device="cdrom">
Nov 21 14:19:10 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none"/>
Nov 21 14:19:10 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b/disk.config"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="hda" bus="ide"/>
Nov 21 14:19:10 user nova-compute[74882]:     </disk>
Nov 21 14:19:10 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:19:10 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:19:10 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <serial>61b0d03a-6007-4a40-858a-33490851ad91</serial>
Nov 21 14:19:10 user nova-compute[74882]:     </disk>
Nov 21 14:19:10 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:19:10 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:19:10 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <serial>51ffdcef-a58a-4101-a967-2a66ec25ad93</serial>
Nov 21 14:19:10 user nova-compute[74882]:     </disk>
Nov 21 14:19:10 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:19:10 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:19:10 user nova-compute[74882]:       <source dev="/dev/sdd"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="vdc" bus="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <serial>edecdce9-a757-4671-8c6f-72b9d5048db1</serial>
Nov 21 14:19:10 user nova-compute[74882]:     </disk>
Nov 21 14:19:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:10 user nova-compute[74882]:       <mac address="fa:16:3e:1a:07:de"/>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="tap77f1d830-ef"/>
Nov 21 14:19:10 user nova-compute[74882]:     </interface>
Nov 21 14:19:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:10 user nova-compute[74882]:       <mac address="fa:16:3e:b2:9b:a0"/>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="tap2da6bd78-a4"/>
Nov 21 14:19:10 user nova-compute[74882]:     </interface>
Nov 21 14:19:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:10 user nova-compute[74882]:       <mac address="fa:16:3e:70:35:b5"/>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="tap3bff0e3f-59"/>
Nov 21 14:19:10 user nova-compute[74882]:     </interface>
Nov 21 14:19:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:10 user nova-compute[74882]:       <mac address="fa:16:3e:f9:79:03"/>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="tap33afd222-32"/>
Nov 21 14:19:10 user nova-compute[74882]:     </interface>
Nov 21 14:19:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:10 user nova-compute[74882]:       <mac address="fa:16:3e:b6:e3:ef"/>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="tapa39dce5a-20"/>
Nov 21 14:19:10 user nova-compute[74882]:     </interface>
Nov 21 14:19:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:10 user nova-compute[74882]:       <mac address="fa:16:3e:27:26:42"/>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="tape4ad7de7-0f"/>
Nov 21 14:19:10 user nova-compute[74882]:     </interface>
Nov 21 14:19:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:10 user nova-compute[74882]:       <mac address="fa:16:3e:a8:64:1c"/>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:10 user nova-compute[74882]:       <target dev="tapdc19bf1d-6c"/>
Nov 21 14:19:10 user nova-compute[74882]:     </interface>
Nov 21 14:19:10 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:19:10 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b/console.log" append="off"/>
Nov 21 14:19:10 user nova-compute[74882]:     </serial>
Nov 21 14:19:10 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:19:10 user nova-compute[74882]:     <video>
Nov 21 14:19:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:10 user nova-compute[74882]:     </video>
Nov 21 14:19:10 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:19:10 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:19:10 user nova-compute[74882]:     </rng>
Nov 21 14:19:10 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:19:10 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:19:10 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:19:10 user nova-compute[74882]:     </memballoon>
Nov 21 14:19:10 user nova-compute[74882]:   </devices>
Nov 21 14:19:10 user nova-compute[74882]: </domain>
Nov 21 14:19:10 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:07:de,bridge_name='br-int',has_traffic_filtering=True,id=77f1d830-ef25-47d5-a04a-76b7596eb24d,network=Network(86bf0a81-542a-451d-8a26-2242103f9498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f1d830-ef') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:07:de,bridge_name='br-int',has_traffic_filtering=True,id=77f1d830-ef25-47d5-a04a-76b7596eb24d,network=Network(86bf0a81-542a-451d-8a26-2242103f9498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f1d830-ef') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '986880b9-2a60-5a6f-acd0-4fc364cc296a', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77f1d830-ef, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77f1d830-ef, col_values=(('qos', UUID('a1ab6cd2-6e18-43b9-922b-4454c0b943db')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77f1d830-ef, col_values=(('external_ids', {'iface-id': '77f1d830-ef25-47d5-a04a-76b7596eb24d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:07:de', 'vm-uuid': '8e29b0dc-380b-42d1-a43d-048de2d2e57b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: INFO os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:07:de,bridge_name='br-int',has_traffic_filtering=True,id=77f1d830-ef25-47d5-a04a-76b7596eb24d,network=Network(86bf0a81-542a-451d-8a26-2242103f9498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f1d830-ef')
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9b:a0,bridge_name='br-int',has_traffic_filtering=True,id=2da6bd78-a4c0-4728-81e0-853c89c882fe,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2da6bd78-a4') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9b:a0,bridge_name='br-int',has_traffic_filtering=True,id=2da6bd78-a4c0-4728-81e0-853c89c882fe,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2da6bd78-a4') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '845babb9-4358-5849-bac1-fcc034844560', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2da6bd78-a4, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2da6bd78-a4, col_values=(('qos', UUID('32ccef0e-637c-4488-99be-eecadd3a37b7')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2da6bd78-a4, col_values=(('external_ids', {'iface-id': '2da6bd78-a4c0-4728-81e0-853c89c882fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:9b:a0', 'vm-uuid': '8e29b0dc-380b-42d1-a43d-048de2d2e57b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: INFO os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9b:a0,bridge_name='br-int',has_traffic_filtering=True,id=2da6bd78-a4c0-4728-81e0-853c89c882fe,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2da6bd78-a4')
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:35:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bff0e3f-5977-4912-8998-ee250fc4ab87,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bff0e3f-59') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:35:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bff0e3f-5977-4912-8998-ee250fc4ab87,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bff0e3f-59') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '112c411d-1252-5ca5-a14d-828ebe08eae1', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bff0e3f-59, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bff0e3f-59, col_values=(('qos', UUID('cb3a1ea3-d0c5-4f0b-b1cf-eafdff0ce006')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bff0e3f-59, col_values=(('external_ids', {'iface-id': '3bff0e3f-5977-4912-8998-ee250fc4ab87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:35:b5', 'vm-uuid': '8e29b0dc-380b-42d1-a43d-048de2d2e57b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: INFO os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:35:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bff0e3f-5977-4912-8998-ee250fc4ab87,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bff0e3f-59')
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:79:03,bridge_name='br-int',has_traffic_filtering=True,id=33afd222-329a-46d7-81b1-f24247b83c00,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33afd222-32') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:79:03,bridge_name='br-int',has_traffic_filtering=True,id=33afd222-329a-46d7-81b1-f24247b83c00,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33afd222-32') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a423f737-f0c8-52df-838c-40e2aa682a26', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33afd222-32, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33afd222-32, col_values=(('qos', UUID('68bf9e9b-733b-4f4d-9ab4-e62d5699ad3f')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33afd222-32, col_values=(('external_ids', {'iface-id': '33afd222-329a-46d7-81b1-f24247b83c00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:79:03', 'vm-uuid': '8e29b0dc-380b-42d1-a43d-048de2d2e57b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: INFO os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:79:03,bridge_name='br-int',has_traffic_filtering=True,id=33afd222-329a-46d7-81b1-f24247b83c00,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33afd222-32')
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e3:ef,bridge_name='br-int',has_traffic_filtering=True,id=a39dce5a-2098-4347-82f4-a79edc2b3edf,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39dce5a-20') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e3:ef,bridge_name='br-int',has_traffic_filtering=True,id=a39dce5a-2098-4347-82f4-a79edc2b3edf,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39dce5a-20') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a27842f7-89c2-56cb-8fed-e14dd1856505', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa39dce5a-20, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa39dce5a-20, col_values=(('qos', UUID('60717c83-726e-4832-ae30-c95a11f06cd6')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa39dce5a-20, col_values=(('external_ids', {'iface-id': 'a39dce5a-2098-4347-82f4-a79edc2b3edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:e3:ef', 'vm-uuid': '8e29b0dc-380b-42d1-a43d-048de2d2e57b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: INFO os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e3:ef,bridge_name='br-int',has_traffic_filtering=True,id=a39dce5a-2098-4347-82f4-a79edc2b3edf,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39dce5a-20')
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:26:42,bridge_name='br-int',has_traffic_filtering=True,id=e4ad7de7-0f3a-4611-9aea-96d24957ab96,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ad7de7-0f') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:26:42,bridge_name='br-int',has_traffic_filtering=True,id=e4ad7de7-0f3a-4611-9aea-96d24957ab96,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ad7de7-0f') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a5f832e-8dac-5458-9f11-e62efbb854be', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4ad7de7-0f, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4ad7de7-0f, col_values=(('qos', UUID('bac93123-938d-4f27-8d41-1cffb9dd7c67')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4ad7de7-0f, col_values=(('external_ids', {'iface-id': 'e4ad7de7-0f3a-4611-9aea-96d24957ab96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:26:42', 'vm-uuid': '8e29b0dc-380b-42d1-a43d-048de2d2e57b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: INFO os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:26:42,bridge_name='br-int',has_traffic_filtering=True,id=e4ad7de7-0f3a-4611-9aea-96d24957ab96,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ad7de7-0f')
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:64:1c,bridge_name='br-int',has_traffic_filtering=True,id=dc19bf1d-6c50-486a-952c-3b3d067409f7,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc19bf1d-6c') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:64:1c,bridge_name='br-int',has_traffic_filtering=True,id=dc19bf1d-6c50-486a-952c-3b3d067409f7,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc19bf1d-6c') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa6c3a06-5c24-5e7f-95f0-b01f63daf41f', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc19bf1d-6c, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc19bf1d-6c, col_values=(('qos', UUID('2f18b484-1024-4397-a0a8-1e7fb19d9d5b')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc19bf1d-6c, col_values=(('external_ids', {'iface-id': 'dc19bf1d-6c50-486a-952c-3b3d067409f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:64:1c', 'vm-uuid': '8e29b0dc-380b-42d1-a43d-048de2d2e57b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:10 user nova-compute[74882]: INFO os_vif [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:64:1c,bridge_name='br-int',has_traffic_filtering=True,id=dc19bf1d-6c50-486a-952c-3b3d067409f7,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc19bf1d-6c')
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] No BDM found with device name hda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] No VIF found with MAC fa:16:3e:1a:07:de, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] No VIF found with MAC fa:16:3e:b6:e3:ef, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Using config drive
Nov 21 14:19:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Creating config drive at /opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b/disk.config
Nov 21 14:19:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy_tgzpx5 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpy_tgzpx5" returned: 0 in 0.072s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:13 user nova-compute[74882]: WARNING nova.compute.manager [req-b5b1d22a-b19c-4306-b763-8c610d9a9fbb req-01aad6cc-79eb-4262-80a8-a848492539f6 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d for instance with vm_state building and task_state spawning.
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:13 user nova-compute[74882]: WARNING nova.compute.manager [req-715ddc1c-c98f-4e01-b379-89d8f3491778 req-ff6da61b-4577-470a-9a31-33d230dfcd95 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe for instance with vm_state building and task_state spawning.
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:13 user nova-compute[74882]: WARNING nova.compute.manager [req-1c38b899-a011-496c-9d33-bf58136f3251 req-0c68ff16-3ff3-430e-b1be-8c1f6c1deeaa service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance with vm_state building and task_state spawning.
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-1c894e02-dac5-455c-97d3-de94efcd1287 req-86594e19-a769-4c61-a4b1-8723b551770d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-762e166d-1d97-4683-a195-ded00b58028d req-b86f800a-3522-423d-88ec-92999f12ff08 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance with vm_state building and task_state spawning.
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:15 user nova-compute[74882]: WARNING nova.compute.manager [req-f18d28d4-e731-4a67-9472-32bf2c5d30bc req-52873ff7-0130-4595-ab20-876ed90db514 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance with vm_state building and task_state spawning.
Nov 21 14:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:19:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance spawned successfully.
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:17 user nova-compute[74882]: INFO nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Took 11.30 seconds to spawn the instance on the hypervisor.
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:19:17 user nova-compute[74882]: INFO nova.compute.manager [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Took 34.16 seconds to build instance.
Nov 21 14:19:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-21374721-2571-472f-baa7-938a45f723b6 tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.379s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:17 user nova-compute[74882]: WARNING nova.compute.manager [req-b11c8146-1fb7-41e3-b452-1696500cf72c req-aad511ac-8287-410c-a403-28f84732075d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance with vm_state active and task_state None.
Nov 21 14:19:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:19 user nova-compute[74882]: DEBUG nova.objects.instance [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lazy-loading 'flavor' on Instance uuid c8f0dc3a-93fe-4de4-b362-1a71696277bf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:20 user nova-compute[74882]: INFO nova.compute.manager [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Attaching volume 07d58ba8-3770-4f84-9c2c-5573f24f3979 to /dev/vdb
Nov 21 14:19:20 user nova-compute[74882]: DEBUG os_brick.utils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3879e094-35c9-460e-84cf-caf1dd4b1208]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06397aa-500d-4e5a-876c-d1d60624c5cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9ddec6-4e63-45c1-b245-87d78cd405fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808e80a-0123-49b5-b0a0-d82ea6350d43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:20 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:19:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[059425bc-6d58-492a-8b14-841b206d700e]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG os_brick.utils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updating existing volume attachment record: 60a3bc47-ac82-4953-acb5-76132494a703 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:19:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:19:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "51a5901c-6c03-4b4d-8737-8780e7224fcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:19:22 user nova-compute[74882]: INFO nova.compute.claims [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Claim successful on node user
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:22 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:19:23 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.policy [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec7d58eda515420f8b815338d2efd377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8612dc478d4a40babe74b1fbf45eac93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:19:23 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Creating image(s)
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "/opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "/opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "/opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.227s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.209s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Successfully created port: 77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk 1073741824" returned: 0 in 0.054s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.190s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Cannot resize image /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Ensure instance console log exists: /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Successfully updated port: 77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "refresh_cache-51a5901c-6c03-4b4d-8737-8780e7224fcf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquired lock "refresh_cache-51a5901c-6c03-4b4d-8737-8780e7224fcf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received event network-changed-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Refreshing instance network info cache due to event network-changed-77c09ab5-9563-4a3c-b841-2919c6b2db58. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Acquiring lock "refresh_cache-51a5901c-6c03-4b4d-8737-8780e7224fcf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Updating instance_info_cache with network_info: [{"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Releasing lock "refresh_cache-51a5901c-6c03-4b4d-8737-8780e7224fcf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Instance network_info: |[{"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Acquired lock "refresh_cache-51a5901c-6c03-4b4d-8737-8780e7224fcf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.neutron [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Refreshing network info cache for port 77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Start _get_guest_xml network_info=[{"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:19:25 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:25 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1156448244',display_name='tempest-ServersNegativeTestJSON-server-1156448244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1156448244',id=11,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8612dc478d4a40babe74b1fbf45eac93',ramdisk_id='',reservation_id='r-sehx8bvo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1655313892',owner_user_name='tempest-ServersNegativeTestJSON-1655313892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:19:23Z,user_data=None,user_id='ec7d58eda515420f8b815338d2efd377',uuid=51a5901c-6c03-4b4d-8737-8780e7224fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converting VIF {"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=77c09ab5-9563-4a3c-b841-2919c6b2db58,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c09ab5-95') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lazy-loading 'pci_devices' on Instance uuid 51a5901c-6c03-4b4d-8737-8780e7224fcf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:19:25 user nova-compute[74882]:   <uuid>51a5901c-6c03-4b4d-8737-8780e7224fcf</uuid>
Nov 21 14:19:25 user nova-compute[74882]:   <name>instance-0000000b</name>
Nov 21 14:19:25 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:19:25 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:19:25 user nova-compute[74882]:   <metadata>
Nov 21 14:19:25 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:19:25 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:19:25 user nova-compute[74882]:       <nova:name>tempest-ServersNegativeTestJSON-server-1156448244</nova:name>
Nov 21 14:19:25 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:19:25</nova:creationTime>
Nov 21 14:19:25 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:19:25 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:19:25 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:19:25 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:19:25 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:19:25 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:19:25 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:19:25 user nova-compute[74882]:       <nova:owner>
Nov 21 14:19:25 user nova-compute[74882]:         <nova:user uuid="ec7d58eda515420f8b815338d2efd377">tempest-ServersNegativeTestJSON-1655313892-project-member</nova:user>
Nov 21 14:19:25 user nova-compute[74882]:         <nova:project uuid="8612dc478d4a40babe74b1fbf45eac93">tempest-ServersNegativeTestJSON-1655313892</nova:project>
Nov 21 14:19:25 user nova-compute[74882]:       </nova:owner>
Nov 21 14:19:25 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:19:25 user nova-compute[74882]:       <nova:ports>
Nov 21 14:19:25 user nova-compute[74882]:         <nova:port uuid="77c09ab5-9563-4a3c-b841-2919c6b2db58">
Nov 21 14:19:25 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 21 14:19:25 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:25 user nova-compute[74882]:       </nova:ports>
Nov 21 14:19:25 user nova-compute[74882]:     </nova:instance>
Nov 21 14:19:25 user nova-compute[74882]:   </metadata>
Nov 21 14:19:25 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:19:25 user nova-compute[74882]:     <system>
Nov 21 14:19:25 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:19:25 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:19:25 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:19:25 user nova-compute[74882]:       <entry name="serial">51a5901c-6c03-4b4d-8737-8780e7224fcf</entry>
Nov 21 14:19:25 user nova-compute[74882]:       <entry name="uuid">51a5901c-6c03-4b4d-8737-8780e7224fcf</entry>
Nov 21 14:19:25 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:19:25 user nova-compute[74882]:     </system>
Nov 21 14:19:25 user nova-compute[74882]:   </sysinfo>
Nov 21 14:19:25 user nova-compute[74882]:   <os>
Nov 21 14:19:25 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:19:25 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:19:25 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:19:25 user nova-compute[74882]:   </os>
Nov 21 14:19:25 user nova-compute[74882]:   <features>
Nov 21 14:19:25 user nova-compute[74882]:     <acpi/>
Nov 21 14:19:25 user nova-compute[74882]:     <apic/>
Nov 21 14:19:25 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:19:25 user nova-compute[74882]:   </features>
Nov 21 14:19:25 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:19:25 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:19:25 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:19:25 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:19:25 user nova-compute[74882]:   </clock>
Nov 21 14:19:25 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:19:25 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:19:25 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:19:25 user nova-compute[74882]:   </cpu>
Nov 21 14:19:25 user nova-compute[74882]:   <devices>
Nov 21 14:19:25 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:19:25 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:19:25 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk"/>
Nov 21 14:19:25 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:19:25 user nova-compute[74882]:     </disk>
Nov 21 14:19:25 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:25 user nova-compute[74882]:       <mac address="fa:16:3e:4a:2b:34"/>
Nov 21 14:19:25 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:25 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:25 user nova-compute[74882]:       <target dev="tap77c09ab5-95"/>
Nov 21 14:19:25 user nova-compute[74882]:     </interface>
Nov 21 14:19:25 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:19:25 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/console.log" append="off"/>
Nov 21 14:19:25 user nova-compute[74882]:     </serial>
Nov 21 14:19:25 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:19:25 user nova-compute[74882]:     <video>
Nov 21 14:19:25 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:25 user nova-compute[74882]:     </video>
Nov 21 14:19:25 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:19:25 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:19:25 user nova-compute[74882]:     </rng>
Nov 21 14:19:25 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:19:25 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:19:25 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:19:25 user nova-compute[74882]:     </memballoon>
Nov 21 14:19:25 user nova-compute[74882]:   </devices>
Nov 21 14:19:25 user nova-compute[74882]: </domain>
Nov 21 14:19:25 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1156448244',display_name='tempest-ServersNegativeTestJSON-server-1156448244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1156448244',id=11,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8612dc478d4a40babe74b1fbf45eac93',ramdisk_id='',reservation_id='r-sehx8bvo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1655313892',owner_user_name='tempest-ServersNegativeTestJSON-1655313892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:19:23Z,user_data=None,user_id='ec7d58eda515420f8b815338d2efd377',uuid=51a5901c-6c03-4b4d-8737-8780e7224fcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converting VIF {"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=77c09ab5-9563-4a3c-b841-2919c6b2db58,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c09ab5-95') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG os_vif [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=77c09ab5-9563-4a3c-b841-2919c6b2db58,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c09ab5-95') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad664f10-e209-54bb-880b-3d534d64ff42', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77c09ab5-95, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77c09ab5-95, col_values=(('qos', UUID('0fd42e66-cf01-4b23-bbd3-b8694b6f6141')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77c09ab5-95, col_values=(('external_ids', {'iface-id': '77c09ab5-9563-4a3c-b841-2919c6b2db58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:2b:34', 'vm-uuid': '51a5901c-6c03-4b4d-8737-8780e7224fcf'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:25 user nova-compute[74882]: INFO os_vif [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=77c09ab5-9563-4a3c-b841-2919c6b2db58,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c09ab5-95')
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] No VIF found with MAC fa:16:3e:4a:2b:34, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.neutron [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Updated VIF entry in instance network info cache for port 77c09ab5-9563-4a3c-b841-2919c6b2db58. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG nova.network.neutron [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Updating instance_info_cache with network_info: [{"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b365ad69-2ed0-44c5-ba5d-f7207172fc86 req-54ff86c3-597b-48db-addb-88603f96dc9f service nova] Releasing lock "refresh_cache-51a5901c-6c03-4b4d-8737-8780e7224fcf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received event network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Acquiring lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] No waiting events found dispatching network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:29 user nova-compute[74882]: WARNING nova.compute.manager [req-4020f0c2-713c-42d7-9fa8-d0dbe1143b10 req-e6200acc-bb4e-4d8a-a017-6a27542251bb service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received unexpected event network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance with vm_state building and task_state spawning.
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received event network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Acquiring lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] No waiting events found dispatching network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:29 user nova-compute[74882]: WARNING nova.compute.manager [req-b15b4c91-91f2-499d-ac0a-0dc9cdeae6cf req-c600224f-77a7-409f-8777-571c53ccc5ce service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received unexpected event network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance with vm_state building and task_state spawning.
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:19:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7152MB free_disk=25.49456024169922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Instance spawned successfully.
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:19:29 user nova-compute[74882]: INFO nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance b33785fd-01ad-4d08-9b66-f664b7440b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance aed46662-03d4-4005-967f-56759e6dbe02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:19:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:19:30 user nova-compute[74882]: INFO nova.compute.manager [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Took 7.66 seconds to build instance.
Nov 21 14:19:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5a0b2bf1-d30a-4fe2-8fc4-6d496facea3e tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.805s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:30 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:19:30 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:19:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:19:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-changed-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Refreshing instance network info cache due to event network-changed-c0cf7d6d-fa0c-42c8-b031-069446ad2314. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Acquiring lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Acquired lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Refreshing network info cache for port c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:19:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updated VIF entry in instance network info cache for port c0cf7d6d-fa0c-42c8-b031-069446ad2314. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updating instance_info_cache with network_info: [{"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cba79681-0f5a-44b0-8cfc-cfd776ea0af8 req-3aa1ed9d-a64d-447f-9791-1c75cce225bc service nova] Releasing lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLJAzsYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:33 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:33 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:33 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d1e88c-d958-4c8b-83e1-8fbd7a8e110f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:19:33 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5575971-6c70-4021-a146-c40a38e27265]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979] added
Nov 21 14:19:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed51651-571c-4252-a00a-97c0bb40064a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cedd6c-992a-40d2-801e-bb2b8843ca04]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLJAzsYN {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLJAzsYN" returned: 0 in 0.034s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c5ebc9-6aa0-4887-88b1-07851c978523]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLJAzsYN'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e5f36c-3d94-401c-8ee2-463419c79d4f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f72795-717a-4e58-b65a-c053927990fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a34068-f3a7-412d-bc4f-5a8a6af2b1f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260]
Nov 21 14:19:33 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260] successful.
Nov 21 14:19:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c1556-2d02-4fa7-b6b6-e4735fbd92fc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45dd49-934c-4097-89fb-e08c81ee4172]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 (non-flash)
Nov 21 14:19:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[890a66c0-1468-47c8-8ecc-a94240e89cbb]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLJAzsYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-changed-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Refreshing instance network info cache due to event network-changed-f39421d4-14c9-470b-9aab-7c4b25deccd2. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Acquiring lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Acquired lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Refreshing network info cache for port f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updating instance_info_cache with network_info: [{"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-changed-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Refreshing instance network info cache due to event network-changed-a2969955-0235-4311-83c4-3d30b0e2ac53. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Acquiring lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Acquired lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Refreshing network info cache for port a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG nova.objects.instance [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.network.neutron [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updated VIF entry in instance network info cache for port f39421d4-14c9-470b-9aab-7c4b25deccd2. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.network.neutron [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b4058bf6-8d8c-4bb1-a0e3-2af87dfb736f req-1c15603e-939b-440e-88f7-8bbfb9aa664f service nova] Releasing lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:34 user nova-compute[74882]: INFO nova.compute.manager [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Attaching volume 42e5cac6-874f-4823-8631-5e556909e9ce to /dev/vdb
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.network.neutron [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updated VIF entry in instance network info cache for port a2969955-0235-4311-83c4-3d30b0e2ac53. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.network.neutron [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '26561386239343735', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561386239343735', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.objects.instance [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lazy-loading 'flavor' on Instance uuid c8f0dc3a-93fe-4de4-b362-1a71696277bf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.utils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3ce395-28eb-4538-9bb6-0fba559ebfb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:19:34 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:19:34 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:19:34 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:19:34 user nova-compute[74882]:   <serial>07d58ba8-3770-4f84-9c2c-5573f24f3979</serial>
Nov 21 14:19:34 user nova-compute[74882]: </disk>
Nov 21 14:19:34 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[339f0bfc-bd3a-43f6-bf16-d8bab39d8e77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dbb2e4e1-1978-45b4-a4e2-9f553c349b12 req-37f89e1c-5396-4244-94b2-3a4c8e9560ef service nova] Releasing lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.131s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bc95f-5051-494b-b3a2-9613b358741e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c121681b-8aae-4ca5-8fac-78a17b1795d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:34 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:19:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c899d578-b87b-439d-89ae-432cdc566509]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG os_brick.utils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:34 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updating existing volume attachment record: f2b92f6e-6c08-40f4-bec7-65938bdea896 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] No VIF found with MAC fa:16:3e:b0:94:fa, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8eb94ed9-cbb1-495c-80ac-5e90438e000e tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.088s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:35 user nova-compute[74882]: INFO nova.compute.manager [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Terminating instance
Nov 21 14:19:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:19:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received event network-vif-unplugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] No waiting events found dispatching network-vif-unplugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-8342dfe1-3464-412f-8518-6bc68c963399 req-b3e7f71b-0279-4831-8162-ede7d05d1f9e service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received event network-vif-unplugged-932be03a-30bb-4fd3-bfed-064cb3a73698 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:19:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Instance destroyed successfully.
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.objects.instance [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lazy-loading 'resources' on Instance uuid c8f0dc3a-93fe-4de4-b362-1a71696277bf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1455144124',display_name='tempest-DeleteServersTestJSON-server-1455144124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1455144124',id=1,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df1a7387e11d461088e466338a2804e2',ramdisk_id='',reservation_id='r-jf4tnhdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1173355209',owner_user_name='tempest-DeleteServersTestJSON-1173355209-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:17:39Z,user_data=None,user_id='d20e3b99a4f246eb89174a4e87e5da4a',uuid=c8f0dc3a-93fe-4de4-b362-1a71696277bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Converting VIF {"id": "932be03a-30bb-4fd3-bfed-064cb3a73698", "address": "fa:16:3e:b0:94:fa", "network": {"id": "fd9e560f-4f37-4aa6-8f88-8dbb8870100b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-776493965-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1a7387e11d461088e466338a2804e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap932be03a-30", "ovs_interfaceid": "932be03a-30bb-4fd3-bfed-064cb3a73698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=932be03a-30bb-4fd3-bfed-064cb3a73698,network=Network(fd9e560f-4f37-4aa6-8f88-8dbb8870100b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932be03a-30') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG os_vif [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=932be03a-30bb-4fd3-bfed-064cb3a73698,network=Network(fd9e560f-4f37-4aa6-8f88-8dbb8870100b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932be03a-30') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap932be03a-30, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=955ac489-6027-4f35-b06c-f00e7d17a493) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:36 user nova-compute[74882]: INFO os_vif [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:94:fa,bridge_name='br-int',has_traffic_filtering=True,id=932be03a-30bb-4fd3-bfed-064cb3a73698,network=Network(fd9e560f-4f37-4aa6-8f88-8dbb8870100b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap932be03a-30')
Nov 21 14:19:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLJAzsYN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:36 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5675371-35d6-4846-aca7-b366d520529a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:19:36 user nova-compute[74882]: No targets found.
Nov 21 14:19:36 user nova-compute[74882]: iSNS:
Nov 21 14:19:36 user nova-compute[74882]: No targets found.
Nov 21 14:19:36 user nova-compute[74882]: STATIC:
Nov 21 14:19:36 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1
Nov 21 14:19:36 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:19:36 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:19:36 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979
Nov 21 14:19:36 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:19:36 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:19:36 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93
Nov 21 14:19:36 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:19:36 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:19:36 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91
Nov 21 14:19:36 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:19:36 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:19:36 user nova-compute[74882]: FIRMWARE:
Nov 21 14:19:36 user nova-compute[74882]: No targets found.
Nov 21 14:19:36 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:19:36 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:19:36 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:19:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222d61a-3026-4abd-b842-f0356f2f4eb4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4393c380-4572-4c9e-9467-9e951b01af1f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 (non-flash)
Nov 21 14:19:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c4c5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[052413a1-b0b1-4026-a696-dd0ef6b35ae3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8169ba-a860-4800-98ca-348cd7043f7f]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08e2198-c5f2-474f-b8c4-6b8e2eaca2dc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfbcb68-1702-4968-a684-6bac376972d3]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deeca5b-ace8-49e0-8a9c-15b41f307f08]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3ec761-de2c-4c09-b664-ea9212d6153d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260]
Nov 21 14:19:37 user nova-compute[74882]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979, portal: 172.16.0.220,3260] successful.
Nov 21 14:19:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07d58ba8-3770-4f84-9c2c-5573f24f3979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[94551839-80d2-459a-8db6-42fe84ee69fc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] <== disconnect_volume: return (369ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:19:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Deleting instance files /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf_del
Nov 21 14:19:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Deletion of /opt/stack/data/nova/instances/c8f0dc3a-93fe-4de4-b362-1a71696277bf_del complete
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:37 user nova-compute[74882]: INFO nova.compute.manager [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Attaching volume 949666e2-574c-4f9a-bad7-2074e7b4d4b4 to /dev/vdb
Nov 21 14:19:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74882) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 21 14:19:37 user nova-compute[74882]: INFO nova.virt.libvirt.host [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] UEFI support detected
Nov 21 14:19:37 user nova-compute[74882]: INFO nova.compute.manager [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.utils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[84710e53-d4ad-481b-bc1d-69a98424cd04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b193819f-680e-458f-9c3e-8c3e494b9f0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d1fe9e-3156-42f8-8317-3915c5c145ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3c3fe4-53a7-4d7c-880a-c5431240a996]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:37 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:19:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa22721-d89b-4df3-927e-13f1d97e8580]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG os_brick.utils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:37 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating existing volume attachment record: 6f3c5ea0-53b9-4ac3-b5ff-7dfc51d5634e {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:19:38 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:38 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Took 0.62 seconds to deallocate network for instance.
Nov 21 14:19:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received event network-vif-deleted-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:38 user nova-compute[74882]: INFO nova.compute.manager [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Neutron deleted interface 932be03a-30bb-4fd3-bfed-064cb3a73698; detaching it from the instance and deleting it from the info cache
Nov 21 14:19:38 user nova-compute[74882]: DEBUG nova.network.neutron [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0fcda498-c59d-4c43-9e1e-d793f332447a req-187ca942-3299-4ff1-a3dd-e6a038afbf67 service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Detach interface failed, port_id=932be03a-30bb-4fd3-bfed-064cb3a73698, reason: Instance c8f0dc3a-93fe-4de4-b362-1a71696277bf could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:19:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received event network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Acquiring lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] No waiting events found dispatching network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:38 user nova-compute[74882]: WARNING nova.compute.manager [req-110e19a6-ad9d-420f-bb9b-e5e3b3913490 req-bf2b6c4e-d3a8-4284-b181-a11c719114a7 service nova] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Received unexpected event network-vif-plugged-932be03a-30bb-4fd3-bfed-064cb3a73698 for instance with vm_state active and task_state deleting.
Nov 21 14:19:38 user nova-compute[74882]: INFO nova.compute.manager [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] [instance: c8f0dc3a-93fe-4de4-b362-1a71696277bf] Took 0.85 seconds to detach 1 volumes for instance.
Nov 21 14:19:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:39 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:19:39 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:19:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:39 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Deleted allocations for instance c8f0dc3a-93fe-4de4-b362-1a71696277bf
Nov 21 14:19:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39b08f39-ba43-4acc-9cca-6db7f18b3612 tempest-DeleteServersTestJSON-1173355209 tempest-DeleteServersTestJSON-1173355209-project-member] Lock "c8f0dc3a-93fe-4de4-b362-1a71696277bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.758s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsMVroPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:44 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:44 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:44 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab17dbb-7482-4a73-859e-0ee246f4e11c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:19:44 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1057ddf2-f603-4276-9596-b856239f0d01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4] added
Nov 21 14:19:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f638fa26-5e25-4c4b-b8cd-5c78e339ff85]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5e9911-81cb-4d14-8d29-4a4ff7da5d0f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsMVroPO {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsMVroPO" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c46ca2-f847-4356-9ba1-a27ae5f12d6c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SsMVroPO'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a4285-2515-4378-a89b-525980f09175]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b71d5-8cb8-4673-b1ec-9c136e62ca52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb99ec-d9df-4ce2-92bb-47cc6c1cee58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]
Nov 21 14:19:44 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.
Nov 21 14:19:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6218f-f531-47c4-9fec-94232b084586]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a660bf-6035-485a-ab59-868842904c02]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:19:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[027edfcb-5652-4966-8ba4-a8ca19293cc2]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMZNHQxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:45 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsMVroPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26330666430613530', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330666430613530', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.075s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:45 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:19:45 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c0bf50-fc17-43fd-bb92-662e901d038f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:19:45 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:19:45 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:19:45 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:19:45 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:19:45 user nova-compute[74882]:   <serial>949666e2-574c-4f9a-bad7-2074e7b4d4b4</serial>
Nov 21 14:19:45 user nova-compute[74882]: </disk>
Nov 21 14:19:45 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da1a19e-bee5-4210-8317-51495dd0422c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce] added
Nov 21 14:19:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3bf3a4-48ae-4318-b094-295c5da21578]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bf3323-9cd6-447a-99ba-832b5aca1042]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMZNHQxG {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMZNHQxG" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e99472-4364-44f5-9479-ffa1f9d52ee9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AMZNHQxG'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bbdd85-fe0d-46dc-be38-759f8bff18eb]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fbd6b1-cf16-4419-b4d7-0580588d7d67]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:19:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee44726-290b-4e35-8d4d-a941c613d2d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260]
Nov 21 14:19:45 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260] successful.
Nov 21 14:19:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6ffb31-f873-4086-b263-4cbe4a58f8cc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:19:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[07da7577-bc11-4847-aec0-63ff1e5c06b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:19:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:19:46 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:19:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13af9b-05f7-4572-a469-afc9c58773eb]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMZNHQxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No VIF found with MAC fa:16:3e:5c:a6:7f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6c43ede6-2a08-4137-a646-454200089886 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.959s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74882) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23431363262336263', 'path': '/dev/sdf'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431363262336263', 'path': '/dev/sdf'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:19:47 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:19:47 user nova-compute[74882]:   <source dev="/dev/sdf"/>
Nov 21 14:19:47 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:19:47 user nova-compute[74882]:   <serial>42e5cac6-874f-4823-8631-5e556909e9ce</serial>
Nov 21 14:19:47 user nova-compute[74882]: </disk>
Nov 21 14:19:47 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:47 user nova-compute[74882]: WARNING nova.compute.manager [req-ea233fff-a740-4fd7-aa69-be042fed6905 req-873be583-a0a3-482d-82fd-ee0ea0eacbdc service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state active and task_state powering-off.
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No VIF found with MAC fa:16:3e:47:e6:25, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-11732f71-2e1b-4a72-9610-e40f069b634f tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.235s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance destroyed successfully.
Nov 21 14:19:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:19:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2f36a0ad-5b29-41d1-a814-5772c4504529 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.230s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:49 user nova-compute[74882]: WARNING nova.compute.manager [req-8f595ac5-4ec4-4be5-b1e4-fd4fb880dc40 req-5840ef7f-7597-4f52-b9bc-05531793c11d service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state stopped and task_state None.
Nov 21 14:19:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-changed-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Refreshing instance network info cache due to event network-changed-090c076d-0081-4d00-9cb0-a8e9967622ad. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Acquiring lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Acquired lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Refreshing network info cache for port 090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lazy-loading 'flavor' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Updated VIF entry in instance network info cache for port 090c076d-0081-4d00-9cb0-a8e9967622ad. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Updating instance_info_cache with network_info: [{"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:50 user nova-compute[74882]: INFO nova.compute.manager [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Attaching volume c2e050c2-4d60-4af8-ab76-22189c8983e3 to /dev/vdb
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-549f8cb9-00ff-4fe8-b8a2-4f49ffdb0452 req-3ae1f070-cdce-4268-bc5b-bd9822d5b273 service nova] Releasing lock "refresh_cache-b33785fd-01ad-4d08-9b66-f664b7440b1a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG os_brick.utils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab961084-44b4-471b-b52a-81510b130ab5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1107f18d-f407-4c4f-8b48-a7d46f0eb6eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99ca908-f5d4-4d10-aba2-3b9223533d33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca69ee-e92e-4395-8a08-7eff8a6a1b5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:50 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:19:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e72d490-e5d5-402a-8581-da43b38bb319]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG os_brick.utils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:50 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Updating existing volume attachment record: 44c1bf84-2bf8-4b74-8553-3516958ed8eb {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:19:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "898bb3eb-39ce-4476-84b9-eb258eccbd12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:19:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:19:51 user nova-compute[74882]: INFO nova.compute.claims [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Claim successful on node user
Nov 21 14:19:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-changed-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Refreshing instance network info cache due to event network-changed-a0b8b24e-ecbb-44f4-a461-da537be0c5d1. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Acquiring lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Acquired lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.network.neutron [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Refreshing network info cache for port a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:19:52 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:19:52 user nova-compute[74882]: INFO nova.compute.claims [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Claim successful on node user
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.policy [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.network.neutron [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updated VIF entry in instance network info cache for port a0b8b24e-ecbb-44f4-a461-da537be0c5d1. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.network.neutron [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updating instance_info_cache with network_info: [{"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:19:52 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Creating image(s)
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "/opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3337c723-10e3-4a21-b338-96c8583665e1 req-7fb90a30-2b37-4b18-84b5-627a706b2a16 service nova] Releasing lock "refresh_cache-aed46662-03d4-4005-967f-56759e6dbe02" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk 1073741824" returned: 0 in 0.045s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.955s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Successfully created port: 9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.408s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:19:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.policy [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fa93ca41a2949a0ae5ca758926f613a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5a6d1b33924d6c812036141c0edc9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Cannot resize image /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Ensure instance console log exists: /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:19:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Creating image(s)
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "/opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "/opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Successfully updated port: 9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquired lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-changed-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Refreshing instance network info cache due to event network-changed-9b592c77-100d-4bcd-8922-ca8fadfb012a. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Acquiring lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk 1073741824" returned: 0 in 0.046s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Successfully created port: 50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Updating instance_info_cache with network_info: [{"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Releasing lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Instance network_info: |[{"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Acquired lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.neutron [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Refreshing network info cache for port 9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Start _get_guest_xml network_info=[{"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:19:54 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:54 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Cannot resize image /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Ensure instance console log exists: /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-321117593',display_name='tempest-AttachVolumeNegativeTest-server-321117593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-321117593',id=12,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmIiYZduC/8zjcxqC2bk1JleTD0+t/hkaazJI/k/Il/NHseBS83IvC42+J66mS/tO1amTRIYRJ04sNxY0CDyvrg3n10xHf4aXD9ylxnpteEJBrIC5hr41U2WjErWm0YhA==',key_name='tempest-keypair-1382497572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-s7i1lq19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=898bb3eb-39ce-4476-84b9-eb258eccbd12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:10,bridge_name='br-int',has_traffic_filtering=True,id=9b592c77-100d-4bcd-8922-ca8fadfb012a,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b592c77-10') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'pci_devices' on Instance uuid 898bb3eb-39ce-4476-84b9-eb258eccbd12 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:19:54 user nova-compute[74882]:   <uuid>898bb3eb-39ce-4476-84b9-eb258eccbd12</uuid>
Nov 21 14:19:54 user nova-compute[74882]:   <name>instance-0000000c</name>
Nov 21 14:19:54 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:19:54 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:19:54 user nova-compute[74882]:   <metadata>
Nov 21 14:19:54 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:19:54 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:19:54 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeNegativeTest-server-321117593</nova:name>
Nov 21 14:19:54 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:19:54</nova:creationTime>
Nov 21 14:19:54 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:19:54 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:19:54 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:19:54 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:19:54 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:19:54 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:19:54 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:19:54 user nova-compute[74882]:       <nova:owner>
Nov 21 14:19:54 user nova-compute[74882]:         <nova:user uuid="d55abe8426b34d10b31ff6b0aefddd37">tempest-AttachVolumeNegativeTest-1777808809-project-member</nova:user>
Nov 21 14:19:54 user nova-compute[74882]:         <nova:project uuid="dadaa9830cd54eb09daee40d952be38f">tempest-AttachVolumeNegativeTest-1777808809</nova:project>
Nov 21 14:19:54 user nova-compute[74882]:       </nova:owner>
Nov 21 14:19:54 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:19:54 user nova-compute[74882]:       <nova:ports>
Nov 21 14:19:54 user nova-compute[74882]:         <nova:port uuid="9b592c77-100d-4bcd-8922-ca8fadfb012a">
Nov 21 14:19:54 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 21 14:19:54 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:54 user nova-compute[74882]:       </nova:ports>
Nov 21 14:19:54 user nova-compute[74882]:     </nova:instance>
Nov 21 14:19:54 user nova-compute[74882]:   </metadata>
Nov 21 14:19:54 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:19:54 user nova-compute[74882]:     <system>
Nov 21 14:19:54 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:19:54 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:19:54 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:19:54 user nova-compute[74882]:       <entry name="serial">898bb3eb-39ce-4476-84b9-eb258eccbd12</entry>
Nov 21 14:19:54 user nova-compute[74882]:       <entry name="uuid">898bb3eb-39ce-4476-84b9-eb258eccbd12</entry>
Nov 21 14:19:54 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:19:54 user nova-compute[74882]:     </system>
Nov 21 14:19:54 user nova-compute[74882]:   </sysinfo>
Nov 21 14:19:54 user nova-compute[74882]:   <os>
Nov 21 14:19:54 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:19:54 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:19:54 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:19:54 user nova-compute[74882]:   </os>
Nov 21 14:19:54 user nova-compute[74882]:   <features>
Nov 21 14:19:54 user nova-compute[74882]:     <acpi/>
Nov 21 14:19:54 user nova-compute[74882]:     <apic/>
Nov 21 14:19:54 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:19:54 user nova-compute[74882]:   </features>
Nov 21 14:19:54 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:19:54 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:19:54 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:19:54 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:19:54 user nova-compute[74882]:   </clock>
Nov 21 14:19:54 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:19:54 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:19:54 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:19:54 user nova-compute[74882]:   </cpu>
Nov 21 14:19:54 user nova-compute[74882]:   <devices>
Nov 21 14:19:54 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:19:54 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:19:54 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk"/>
Nov 21 14:19:54 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:19:54 user nova-compute[74882]:     </disk>
Nov 21 14:19:54 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:54 user nova-compute[74882]:       <mac address="fa:16:3e:03:49:10"/>
Nov 21 14:19:54 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:54 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:54 user nova-compute[74882]:       <target dev="tap9b592c77-10"/>
Nov 21 14:19:54 user nova-compute[74882]:     </interface>
Nov 21 14:19:54 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:19:54 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/console.log" append="off"/>
Nov 21 14:19:54 user nova-compute[74882]:     </serial>
Nov 21 14:19:54 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:19:54 user nova-compute[74882]:     <video>
Nov 21 14:19:54 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:54 user nova-compute[74882]:     </video>
Nov 21 14:19:54 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:19:54 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:19:54 user nova-compute[74882]:     </rng>
Nov 21 14:19:54 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:19:54 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:19:54 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:19:54 user nova-compute[74882]:     </memballoon>
Nov 21 14:19:54 user nova-compute[74882]:   </devices>
Nov 21 14:19:54 user nova-compute[74882]: </domain>
Nov 21 14:19:54 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-321117593',display_name='tempest-AttachVolumeNegativeTest-server-321117593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-321117593',id=12,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmIiYZduC/8zjcxqC2bk1JleTD0+t/hkaazJI/k/Il/NHseBS83IvC42+J66mS/tO1amTRIYRJ04sNxY0CDyvrg3n10xHf4aXD9ylxnpteEJBrIC5hr41U2WjErWm0YhA==',key_name='tempest-keypair-1382497572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-s7i1lq19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=898bb3eb-39ce-4476-84b9-eb258eccbd12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:10,bridge_name='br-int',has_traffic_filtering=True,id=9b592c77-100d-4bcd-8922-ca8fadfb012a,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b592c77-10') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG os_vif [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:10,bridge_name='br-int',has_traffic_filtering=True,id=9b592c77-100d-4bcd-8922-ca8fadfb012a,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b592c77-10') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffcd00fb-23b4-50f8-9c64-d1ddfdfdfd43', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b592c77-10, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b592c77-10, col_values=(('qos', UUID('3485e56b-ccd3-403f-9670-48c648f2e21a')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b592c77-10, col_values=(('external_ids', {'iface-id': '9b592c77-100d-4bcd-8922-ca8fadfb012a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:49:10', 'vm-uuid': '898bb3eb-39ce-4476-84b9-eb258eccbd12'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:54 user nova-compute[74882]: INFO os_vif [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:10,bridge_name='br-int',has_traffic_filtering=True,id=9b592c77-100d-4bcd-8922-ca8fadfb012a,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b592c77-10')
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No VIF found with MAC fa:16:3e:03:49:10, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Successfully updated port: 50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquired lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-changed-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Refreshing instance network info cache due to event network-changed-50684016-dcd4-4d67-86ea-28f525147f47. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Acquiring lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Updated VIF entry in instance network info cache for port 9b592c77-100d-4bcd-8922-ca8fadfb012a. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Updating instance_info_cache with network_info: [{"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-563b333c-7f9a-4687-a945-9baa349f5668 req-c5148677-61cd-4c00-acb5-fe0d21431a88 service nova] Releasing lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updating instance_info_cache with network_info: [{"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Releasing lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Instance network_info: |[{"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Acquired lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Refreshing network info cache for port 50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Start _get_guest_xml network_info=[{"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:19:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-69618808',display_name='tempest-TestServerVolumeAttachmentScenario-server-69618808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-69618808',id=13,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8C4Sb2Q7RENKXhjMcarLF6PRNiKCyXOcofalm/J3IWw+EcJ81ODybygv9li61aBZl5/kR1a+1vBMHpkuW9chHW1xqux61eLfsPFrgt66iLl0xFD3cu3JsPDbtgRvozmg==',key_name='tempest-keypair-472520468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa5a6d1b33924d6c812036141c0edc9c',ramdisk_id='',reservation_id='r-ujjbt6ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-29257918',owner_user_name='tempest-TestServerVolumeAttachmentScenario-29257918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:19:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa93ca41a2949a0ae5ca758926f613a',uuid=1ae17530-7c7f-48bf-a225-11be40152845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Converting VIF {"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=50684016-dcd4-4d67-86ea-28f525147f47,network=Network(5d9e28e2-df42-41c9-9d0e-20f8aa058456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50684016-dc') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:19:55 user nova-compute[74882]:   <uuid>1ae17530-7c7f-48bf-a225-11be40152845</uuid>
Nov 21 14:19:55 user nova-compute[74882]:   <name>instance-0000000d</name>
Nov 21 14:19:55 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:19:55 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:19:55 user nova-compute[74882]:   <metadata>
Nov 21 14:19:55 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:19:55 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:19:55 user nova-compute[74882]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-69618808</nova:name>
Nov 21 14:19:55 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:19:55</nova:creationTime>
Nov 21 14:19:55 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:19:55 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:19:55 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:19:55 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:19:55 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:19:55 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:19:55 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:19:55 user nova-compute[74882]:       <nova:owner>
Nov 21 14:19:55 user nova-compute[74882]:         <nova:user uuid="1fa93ca41a2949a0ae5ca758926f613a">tempest-TestServerVolumeAttachmentScenario-29257918-project-member</nova:user>
Nov 21 14:19:55 user nova-compute[74882]:         <nova:project uuid="aa5a6d1b33924d6c812036141c0edc9c">tempest-TestServerVolumeAttachmentScenario-29257918</nova:project>
Nov 21 14:19:55 user nova-compute[74882]:       </nova:owner>
Nov 21 14:19:55 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:19:55 user nova-compute[74882]:       <nova:ports>
Nov 21 14:19:55 user nova-compute[74882]:         <nova:port uuid="50684016-dcd4-4d67-86ea-28f525147f47">
Nov 21 14:19:55 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 14:19:55 user nova-compute[74882]:         </nova:port>
Nov 21 14:19:55 user nova-compute[74882]:       </nova:ports>
Nov 21 14:19:55 user nova-compute[74882]:     </nova:instance>
Nov 21 14:19:55 user nova-compute[74882]:   </metadata>
Nov 21 14:19:55 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:19:55 user nova-compute[74882]:     <system>
Nov 21 14:19:55 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:19:55 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:19:55 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:19:55 user nova-compute[74882]:       <entry name="serial">1ae17530-7c7f-48bf-a225-11be40152845</entry>
Nov 21 14:19:55 user nova-compute[74882]:       <entry name="uuid">1ae17530-7c7f-48bf-a225-11be40152845</entry>
Nov 21 14:19:55 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:19:55 user nova-compute[74882]:     </system>
Nov 21 14:19:55 user nova-compute[74882]:   </sysinfo>
Nov 21 14:19:55 user nova-compute[74882]:   <os>
Nov 21 14:19:55 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:19:55 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:19:55 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:19:55 user nova-compute[74882]:   </os>
Nov 21 14:19:55 user nova-compute[74882]:   <features>
Nov 21 14:19:55 user nova-compute[74882]:     <acpi/>
Nov 21 14:19:55 user nova-compute[74882]:     <apic/>
Nov 21 14:19:55 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:19:55 user nova-compute[74882]:   </features>
Nov 21 14:19:55 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:19:55 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:19:55 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:19:55 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:19:55 user nova-compute[74882]:   </clock>
Nov 21 14:19:55 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:19:55 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:19:55 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:19:55 user nova-compute[74882]:   </cpu>
Nov 21 14:19:55 user nova-compute[74882]:   <devices>
Nov 21 14:19:55 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:19:55 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:19:55 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk"/>
Nov 21 14:19:55 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:19:55 user nova-compute[74882]:     </disk>
Nov 21 14:19:55 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:19:55 user nova-compute[74882]:       <mac address="fa:16:3e:d8:3b:23"/>
Nov 21 14:19:55 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:55 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:19:55 user nova-compute[74882]:       <target dev="tap50684016-dc"/>
Nov 21 14:19:55 user nova-compute[74882]:     </interface>
Nov 21 14:19:55 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:19:55 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/console.log" append="off"/>
Nov 21 14:19:55 user nova-compute[74882]:     </serial>
Nov 21 14:19:55 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:19:55 user nova-compute[74882]:     <video>
Nov 21 14:19:55 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:19:55 user nova-compute[74882]:     </video>
Nov 21 14:19:55 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:19:55 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:19:55 user nova-compute[74882]:     </rng>
Nov 21 14:19:55 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:19:55 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:19:55 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:19:55 user nova-compute[74882]:     </memballoon>
Nov 21 14:19:55 user nova-compute[74882]:   </devices>
Nov 21 14:19:55 user nova-compute[74882]: </domain>
Nov 21 14:19:55 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-69618808',display_name='tempest-TestServerVolumeAttachmentScenario-server-69618808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-69618808',id=13,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8C4Sb2Q7RENKXhjMcarLF6PRNiKCyXOcofalm/J3IWw+EcJ81ODybygv9li61aBZl5/kR1a+1vBMHpkuW9chHW1xqux61eLfsPFrgt66iLl0xFD3cu3JsPDbtgRvozmg==',key_name='tempest-keypair-472520468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa5a6d1b33924d6c812036141c0edc9c',ramdisk_id='',reservation_id='r-ujjbt6ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-29257918',owner_user_name='tempest-TestServerVolumeAttachmentScenario-29257918-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:19:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa93ca41a2949a0ae5ca758926f613a',uuid=1ae17530-7c7f-48bf-a225-11be40152845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Converting VIF {"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=50684016-dcd4-4d67-86ea-28f525147f47,network=Network(5d9e28e2-df42-41c9-9d0e-20f8aa058456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50684016-dc') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG os_vif [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=50684016-dcd4-4d67-86ea-28f525147f47,network=Network(5d9e28e2-df42-41c9-9d0e-20f8aa058456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50684016-dc') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e71e46b6-1d2b-55c1-8d3c-e7b9227da840', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50684016-dc, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50684016-dc, col_values=(('qos', UUID('6e680326-98e7-49f5-b972-0f69191c9b51')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50684016-dc, col_values=(('external_ids', {'iface-id': '50684016-dcd4-4d67-86ea-28f525147f47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:3b:23', 'vm-uuid': '1ae17530-7c7f-48bf-a225-11be40152845'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:55 user nova-compute[74882]: INFO os_vif [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=50684016-dcd4-4d67-86ea-28f525147f47,network=Network(5d9e28e2-df42-41c9-9d0e-20f8aa058456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50684016-dc')
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No VIF found with MAC fa:16:3e:d8:3b:23, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-changed-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Refreshing instance network info cache due to event network-changed-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Acquiring lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Acquired lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:55 user nova-compute[74882]: DEBUG nova.network.neutron [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Refreshing network info cache for port a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updated VIF entry in instance network info cache for port 50684016-dcd4-4d67-86ea-28f525147f47. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updating instance_info_cache with network_info: [{"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8bf7eada-52ca-45b5-8814-2a6cbdd3e21c req-c415cbfc-5e1d-434e-aa46-644b2418b6f2 service nova] Releasing lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lazy-loading 'flavor' on Instance uuid 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-changed-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Refreshing instance network info cache due to event network-changed-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Acquiring lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Acquired lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Refreshing network info cache for port eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Updated VIF entry in instance network info cache for port a0ef15bf-19f8-4250-a6e0-989ee0bbccfa. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Updating instance_info_cache with network_info: [{"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7904a8e6-22ed-4467-89a6-16634ae1f509 req-f5379bfd-c37d-428c-a9a5-808de70097ad service nova] Releasing lock "refresh_cache-6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:56 user nova-compute[74882]: INFO nova.compute.manager [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Attaching volume 55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 to /dev/vdb
Nov 21 14:19:56 user nova-compute[74882]: DEBUG os_brick.utils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90816a7-27ac-44ef-a1e1-190d4c83975f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0c6ad1-5c2b-4f9e-af88-7ecd5ba4a9d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[64360c52-0d7d-409b-a41b-c032fff37a90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d5a11-01c0-4bbb-bfbc-58aa26dcc9d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:56 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a4b519-3a06-4e05-8c7b-61ebb04dce5b]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG os_brick.utils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Updating existing volume attachment record: 37e56220-16b2-4adb-bb72-f7b6a0977735 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "interface-4deaafad-f14d-4525-acaf-1ff5986f3db0-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "interface-4deaafad-f14d-4525-acaf-1ff5986f3db0-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'flavor' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updated VIF entry in instance network info cache for port eba59df5-fece-4e7b-923c-3fd0f0a8c6cd. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating instance_info_cache with network_info: [{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0b231653-ab65-4f84-b87f-0c40e069484d req-6714a101-b76c-4766-bddb-8f62743a9b28 service nova] Releasing lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG nova.objects.instance [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lazy-loading 'flavor' on Instance uuid aed46662-03d4-4005-967f-56759e6dbe02 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'pci_requests' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG nova.objects.base [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Object Instance<4deaafad-f14d-4525-acaf-1ff5986f3db0> lazy-loaded attributes: flavor,pci_requests {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG nova.policy [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed0c9acb0c4a42beb3c41ba4ab44c4a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1525a2b149ed40f9b3bbd98d1792a84c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:57 user nova-compute[74882]: INFO nova.compute.manager [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Attaching volume 7e1d1a23-fa97-464d-88fd-6c284804dfeb to /dev/sdc
Nov 21 14:19:57 user nova-compute[74882]: DEBUG os_brick.utils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f56882-9b0d-45e4-b883-19f3b0e30ede]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f3dfe8-6264-46a4-a323-d52b9c89afb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd6731-d597-4a1d-9c36-092004723fba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d6e31-f2aa-41bf-84f6-ea6426467ab1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:19:57 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:19:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef94aeb9-defc-4db8-a9ea-2db42326737d]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG os_brick.utils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:19:57 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updating existing volume attachment record: 35ff669e-8cec-4b68-876c-120e8a318327 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Successfully created port: 72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Acquiring lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] No waiting events found dispatching network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:58 user nova-compute[74882]: WARNING nova.compute.manager [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received unexpected event network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a for instance with vm_state building and task_state spawning.
Nov 21 14:19:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Acquiring lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] No waiting events found dispatching network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:58 user nova-compute[74882]: WARNING nova.compute.manager [req-9c3c4bc3-74cf-4a52-a056-202a84762c27 req-9049d183-2509-4d5f-b127-7b4b5c0265e7 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received unexpected event network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a for instance with vm_state building and task_state spawning.
Nov 21 14:19:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:19:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] No waiting events found dispatching network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:19:58 user nova-compute[74882]: WARNING nova.compute.manager [req-129b277f-fc79-4c5c-8110-0425badf47df req-fff0ab36-48b1-479d-b546-c65760070deb service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received unexpected event network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 for instance with vm_state building and task_state spawning.
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Successfully updated port: 72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquired lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating instance_info_cache with network_info: [{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Releasing lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1480492247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1480492247',id=9,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA==',key_name='tempest-keypair-733819265',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1525a2b149ed40f9b3bbd98d1792a84c',ramdisk_id='',reservation_id='r-jjuy5qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-607886265',owner_user_name='tempest-TaggedAttachmentsTest-607886265-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0c9acb0c4a42beb3c41ba4ab44c4a8',uuid=4deaafad-f14d-4525-acaf-1ff5986f3db0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converting VIF {"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG os_vif [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6856e04a-24f1-561b-bf61-15f3abca41a9', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72906f62-8c, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72906f62-8c, col_values=(('qos', UUID('c07a8a8c-e693-465d-bac7-356fc5c7467e')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72906f62-8c, col_values=(('external_ids', {'iface-id': '72906f62-8c9d-4af7-9a8d-06fa07fe7950', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:5e:7f', 'vm-uuid': '4deaafad-f14d-4525-acaf-1ff5986f3db0'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:19:59 user nova-compute[74882]: INFO os_vif [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c')
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1480492247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1480492247',id=9,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA==',key_name='tempest-keypair-733819265',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1525a2b149ed40f9b3bbd98d1792a84c',ramdisk_id='',reservation_id='r-jjuy5qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-607886265',owner_user_name='tempest-TaggedAttachmentsTest-607886265-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0c9acb0c4a42beb3c41ba4ab44c4a8',uuid=4deaafad-f14d-4525-acaf-1ff5986f3db0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converting VIF {"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] attach device xml: <interface type="ethernet">
Nov 21 14:19:59 user nova-compute[74882]:   <mac address="fa:16:3e:d8:5e:7f"/>
Nov 21 14:19:59 user nova-compute[74882]:   <model type="virtio"/>
Nov 21 14:19:59 user nova-compute[74882]:   <mtu size="1442"/>
Nov 21 14:19:59 user nova-compute[74882]:   <target dev="tap72906f62-8c"/>
Nov 21 14:19:59 user nova-compute[74882]: </interface>
Nov 21 14:19:59 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:19:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No BDM found with device name hda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No VIF found with MAC fa:16:3e:38:61:c9, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:20:00 user nova-compute[74882]:   <nova:package version="0.0.0"/>
Nov 21 14:20:00 user nova-compute[74882]:   <nova:name>tempest-device-tagging-server-1480492247</nova:name>
Nov 21 14:20:00 user nova-compute[74882]:   <nova:creationTime>2023-11-21 14:20:00</nova:creationTime>
Nov 21 14:20:00 user nova-compute[74882]:   <nova:flavor name="m1.tiny">
Nov 21 14:20:00 user nova-compute[74882]:     <nova:memory>512</nova:memory>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:disk>1</nova:disk>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:swap>0</nova:swap>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:vcpus>1</nova:vcpus>
Nov 21 14:20:00 user nova-compute[74882]:   </nova:flavor>
Nov 21 14:20:00 user nova-compute[74882]:   <nova:owner>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:user uuid="ed0c9acb0c4a42beb3c41ba4ab44c4a8">tempest-TaggedAttachmentsTest-607886265-project-member</nova:user>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:project uuid="1525a2b149ed40f9b3bbd98d1792a84c">tempest-TaggedAttachmentsTest-607886265</nova:project>
Nov 21 14:20:00 user nova-compute[74882]:   </nova:owner>
Nov 21 14:20:00 user nova-compute[74882]:   <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:20:00 user nova-compute[74882]:   <nova:ports>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:port uuid="eba59df5-fece-4e7b-923c-3fd0f0a8c6cd">
Nov 21 14:20:00 user nova-compute[74882]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:20:00 user nova-compute[74882]:     </nova:port>
Nov 21 14:20:00 user nova-compute[74882]:     <nova:port uuid="72906f62-8c9d-4af7-9a8d-06fa07fe7950">
Nov 21 14:20:00 user nova-compute[74882]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Nov 21 14:20:00 user nova-compute[74882]:     </nova:port>
Nov 21 14:20:00 user nova-compute[74882]:   </nova:ports>
Nov 21 14:20:00 user nova-compute[74882]: </nova:instance>
Nov 21 14:20:00 user nova-compute[74882]:  {{(pid=74882) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b5fcde1f-8a7a-44d8-818e-f702c92e6aa1 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "interface-4deaafad-f14d-4525-acaf-1ff5986f3db0-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.567s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-changed-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Refreshing instance network info cache due to event network-changed-72906f62-8c9d-4af7-9a8d-06fa07fe7950. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Acquiring lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Acquired lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Refreshing network info cache for port 72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:20:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Instance spawned successfully.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:20:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Instance spawned successfully.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] No waiting events found dispatching network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:00 user nova-compute[74882]: WARNING nova.compute.manager [req-32e32814-2838-4f3f-88a4-70e0e61f8dd7 req-4a575188-20f0-4dde-ad70-062bf73a6ef2 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received unexpected event network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 for instance with vm_state building and task_state spawning.
Nov 21 14:20:00 user nova-compute[74882]: INFO nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:20:00 user nova-compute[74882]: INFO nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Took 8.04 seconds to spawn the instance on the hypervisor.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updated VIF entry in instance network info cache for port 72906f62-8c9d-4af7-9a8d-06fa07fe7950. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating instance_info_cache with network_info: [{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:00 user nova-compute[74882]: INFO nova.compute.manager [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Took 8.27 seconds to build instance.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Releasing lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:00 user nova-compute[74882]: WARNING nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received unexpected event network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance with vm_state active and task_state None.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:00 user nova-compute[74882]: WARNING nova.compute.manager [req-20fdac59-ab00-4a51-a62e-03d54f0005d5 req-c2831166-9a26-4b1e-a8ef-582deeb292a0 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received unexpected event network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance with vm_state active and task_state None.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e58c8350-9684-49c0-9838-8e01d404f5c0 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.381s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:00 user nova-compute[74882]: INFO nova.compute.manager [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Took 9.17 seconds to build instance.
Nov 21 14:20:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-794ba3cb-ce2e-483a-9839-aea19ecd98f5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.277s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:12 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:12 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:12 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[308c97aa-16be-4f89-ba1f-c947e50668ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:20:12 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f372c7e9-77b8-40ce-94e6-284b64b63679]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3] added
Nov 21 14:20:12 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[db408603-8c7a-49c6-924b-fd9a2da21fb1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67166ab-ac68-4ca1-be77-81ddc0131c2b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsxbGZkF {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsxbGZkF" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[60def22f-97b4-447d-b646-6f7c628ba282]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wsxbGZkF'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f16fa-2550-456a-ba14-95b6c3ba04b1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[06923f9d-c651-4ee2-828e-fc592ed12951]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:12 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:12 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:12 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'flavor' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b0b553-161d-4e72-8ab8-ef6eda8f3a39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]
Nov 21 14:20:12 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:12 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2c6fff-1fc9-4400-96b7-449f55c044a8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeZCUtEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:13 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f21e509-4e12-4bd3-9a20-36a1e02e84ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:13 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0811520-3273-432b-a824-02fd4780c8fb]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYZbPfDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:13 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:13 user nova-compute[74882]: INFO nova.compute.manager [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Attaching volume 94460595-2298-48c4-aff8-08cfddff270d to /dev/vdb
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.utils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60804b5-3d3e-49b7-a873-4472de555575]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e1ff5-a3aa-4c1d-a776-e224f77a5476]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5590d-8b95-460d-b7cb-fe68c635c10c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eb5357-4b5b-4918-83d9-3c7f2136ac9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:20:13 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:20:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e4afff-1a13-41c3-ab1b-09ccfb8fb6c7]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG os_brick.utils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:13 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating existing volume attachment record: 6241a154-4c44-4434-94d6-d0282fdaf120 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26364626234323335', 'path': '/dev/sdg'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364626234323335', 'path': '/dev/sdg'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.075s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:14 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:14 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lazy-loading 'flavor' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[780171f8-6969-410e-a4da-6fb9116a98a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:20:14 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:20:14 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:14 user nova-compute[74882]:   <source dev="/dev/sdg"/>
Nov 21 14:20:14 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:14 user nova-compute[74882]:   <serial>c2e050c2-4d60-4af8-ab76-22189c8983e3</serial>
Nov 21 14:20:14 user nova-compute[74882]: </disk>
Nov 21 14:20:14 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab60621c-274d-4fa0-9392-a32016c9c558]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85] added
Nov 21 14:20:14 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b994699-7916-4e2f-97f8-88382df519d8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02994e0-98f7-456e-9960-32dc1e8f6240]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeZCUtEO {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeZCUtEO" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc496d1-caeb-4aa9-a5d0-55f6cb80cf58]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeZCUtEO'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9826cfe-163d-43ce-8e0a-6de80039ff71]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b4f798-fc70-4a0d-a8bf-4efcf83175c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c61f07-f3d3-40e6-bf2f-060ea1df2cd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260]
Nov 21 14:20:14 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:14 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b95beb-1c41-4ce9-970a-fb5582123c1a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c0d459-2d04-4533-85b0-b93a1630db0a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:14 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bd5e62-ed45-4e61-86e1-c234bf940ca9]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] No VIF found with MAC fa:16:3e:59:5d:47, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9672abf-8f07-4e2c-9024-48b7330f71e2 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.061s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeZCUtEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] <== connect_volume: return (2459ms) {'type': 'block', 'scsi_wwn': '26165646631616436', 'path': '/dev/sdh'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165646631616436', 'path': '/dev/sdh'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.291s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:15 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:15 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lazy-loading 'flavor' on Instance uuid 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[406dfe41-a3de-4a54-83c9-c6b9ef2e90f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:20:15 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] attach device xml: <disk type="block" device="disk">
Nov 21 14:20:15 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:15 user nova-compute[74882]:   <source dev="/dev/sdh"/>
Nov 21 14:20:15 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:15 user nova-compute[74882]:   <serial>55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85</serial>
Nov 21 14:20:15 user nova-compute[74882]: </disk>
Nov 21 14:20:15 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae75b18-2435-4044-b41c-1e3533f7e91b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb] added
Nov 21 14:20:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[64acb789-0b2c-4177-9d3b-75b00d346182]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3be8726-87bc-45eb-8d70-8617f1b4288a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYZbPfDd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zYZbPfDd" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a60f1a3-0cfe-44ee-9e03-13e7c3de132b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zYZbPfDd'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d8dfd-088c-4602-b078-ef446cffd708]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789dd18-c96f-4b7d-ae02-da02c50df2a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2b1b6d-0ee5-4c7e-bec5-7fd4e6048aca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f262ea-c3b3-43e2-9d60-ee3c8ea4bb2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d47e8f-bef0-45da-8f9c-b07ae106329e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[de259401-31ac-41b4-8a02-b7bdf37c9aec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:20:15 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f541f5-9a32-4529-b42c-348c6a89bb59]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5225aeb5-ea79-4b77-8f9d-63638831a6dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260]
Nov 21 14:20:15 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.123s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d894dc5-ed92-448d-9ba2-e71dafb6e1ec]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f5290-724c-439c-bb12-7b280fb439de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.471s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da58d04-1924-4c1b-8d01-5477106d2e02]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYZbPfDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:20:15 user nova-compute[74882]: INFO nova.compute.manager [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Swapping volume c2e050c2-4d60-4af8-ab76-22189c8983e3 for 2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] No VIF found with MAC fa:16:3e:8e:09:e6, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f148e8e-586d-4923-8bb5-ae445f86f949 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.646s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] <== connect_volume: return (3805ms) {'type': 'block', 'scsi_wwn': '26131366462643163', 'path': '/dev/sdi'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131366462643163', 'path': '/dev/sdi'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:20:16 user nova-compute[74882]: DEBUG nova.objects.instance [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lazy-loading 'flavor' on Instance uuid aed46662-03d4-4005-967f-56759e6dbe02 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:20:17 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:17 user nova-compute[74882]:   <source dev="/dev/sdi"/>
Nov 21 14:20:17 user nova-compute[74882]:   <target dev="sdc" bus="scsi"/>
Nov 21 14:20:17 user nova-compute[74882]:   <serial>7e1d1a23-fa97-464d-88fd-6c284804dfeb</serial>
Nov 21 14:20:17 user nova-compute[74882]:   <address type="drive" controller="0" unit="2"/>
Nov 21 14:20:17 user nova-compute[74882]: </disk>
Nov 21 14:20:17 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] volume_snapshot_create: create_info: {'snapshot_id': 'bb22cc46-a61e-4f78-89d9-cad1d6b27fd7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74882) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] snap xml: <domainsnapshot>
Nov 21 14:20:17 user nova-compute[74882]:   <disks>
Nov 21 14:20:17 user nova-compute[74882]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 21 14:20:17 user nova-compute[74882]:       <source file="/dev/new_file"/>
Nov 21 14:20:17 user nova-compute[74882]:     </disk>
Nov 21 14:20:17 user nova-compute[74882]:     <disk name="vda" snapshot="no"/>
Nov 21 14:20:17 user nova-compute[74882]:   </disks>
Nov 21 14:20:17 user nova-compute[74882]: </domainsnapshot>
Nov 21 14:20:17 user nova-compute[74882]:  {{(pid=74882) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.objects.instance [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Lazy-loading 'system_metadata' on Instance uuid 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     rv = execute(f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     six.reraise(c, e, tb)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     raise value
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     rv = meth(*args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     self._volume_snapshot_create(context, instance, guest,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     rv = execute(f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     six.reraise(c, e, tb)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     raise value
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     rv = meth(*args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] 
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] volume_snapshot_delete: delete_info: {'volume_id': '55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85'} {{(pid=74882) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2]     if delete_info['type'] != 'qcow2':
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] KeyError: 'type'
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] 
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] No BDM found with device name sda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] No VIF found with MAC fa:16:3e:75:d0:99, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot bb22cc46-a61e-4f78-89d9-cad1d6b27fd7 could not be found.
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise value
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot bb22cc46-a61e-4f78-89d9-cad1d6b27fd7 could not be found. (HTTP 404) (Request-ID: req-82457314-f5b9-48d2-b759-27eacb8d0058)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot bb22cc46-a61e-4f78-89d9-cad1d6b27fd7 could not be found.
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7f0bfcde-e968-4160-991e-12c3f693f03a)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 21 14:20:17 user nova-compute[74882]: ERROR nova.virt.libvirt.driver 
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server [None req-17773c65-9adb-4b11-b2e0-db6806595af4 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     raise value
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server 
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server [None req-36794c75-d426-4f58-b9b7-e1a6df710917 tempest-VolumesAssistedSnapshotsTest-1112647065 tempest-VolumesAssistedSnapshotsTest-1112647065-project] Exception during message handling: KeyError: 'type'
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 21 14:20:17 user nova-compute[74882]: ERROR oslo_messaging.rpc.server 
Nov 21 14:20:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-683401f9-9bab-4291-9271-d0924a706fb9 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.969s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:17 user nova-compute[74882]: INFO nova.compute.manager [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Detaching volume 55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85
Nov 21 14:20:17 user nova-compute[74882]: INFO nova.virt.block_device [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Attempting to driver detach volume 55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 from mountpoint /dev/vdb
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Attempting to detach device vdb from instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:17 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:17 user nova-compute[74882]:   <source dev="/dev/sdh"/>
Nov 21 14:20:17 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:17 user nova-compute[74882]:   <serial>55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85</serial>
Nov 21 14:20:17 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:20:17 user nova-compute[74882]: </disk>
Nov 21 14:20:17 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Successfully detached device vdb from instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 from the persistent domain config.
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:20:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:17 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:17 user nova-compute[74882]:   <source dev="/dev/sdh"/>
Nov 21 14:20:17 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:17 user nova-compute[74882]:   <serial>55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85</serial>
Nov 21 14:20:17 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:20:17 user nova-compute[74882]: </disk>
Nov 21 14:20:17 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:20:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:18 user nova-compute[74882]: INFO nova.compute.manager [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Detaching volume 7e1d1a23-fa97-464d-88fd-6c284804dfeb
Nov 21 14:20:18 user nova-compute[74882]: INFO nova.virt.block_device [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Attempting to driver detach volume 7e1d1a23-fa97-464d-88fd-6c284804dfeb from mountpoint /dev/sdc
Nov 21 14:20:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Attempting to detach device sdc from instance aed46662-03d4-4005-967f-56759e6dbe02 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:20:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:18 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:18 user nova-compute[74882]:   <source dev="/dev/sdi"/>
Nov 21 14:20:18 user nova-compute[74882]:   <target dev="sdc" bus="scsi"/>
Nov 21 14:20:18 user nova-compute[74882]:   <serial>7e1d1a23-fa97-464d-88fd-6c284804dfeb</serial>
Nov 21 14:20:18 user nova-compute[74882]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 21 14:20:18 user nova-compute[74882]: </disk>
Nov 21 14:20:18 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:18 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Successfully detached device sdc from instance aed46662-03d4-4005-967f-56759e6dbe02 from the persistent domain config.
Nov 21 14:20:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance aed46662-03d4-4005-967f-56759e6dbe02 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:20:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:18 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:18 user nova-compute[74882]:   <source dev="/dev/sdi"/>
Nov 21 14:20:18 user nova-compute[74882]:   <target dev="sdc" bus="scsi"/>
Nov 21 14:20:18 user nova-compute[74882]:   <serial>7e1d1a23-fa97-464d-88fd-6c284804dfeb</serial>
Nov 21 14:20:18 user nova-compute[74882]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 21 14:20:18 user nova-compute[74882]: </disk>
Nov 21 14:20:18 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance aed46662-03d4-4005-967f-56759e6dbe02 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:20:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHYXSrTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b33785fd-01ad-4d08-9b66-f664b7440b1a', 'attached_at': '', 'detached_at': '', 'volume_id': '2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'serial': '2a28eaf2-5a7c-42d2-912a-e025158f62aa'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b33785fd-01ad-4d08-9b66-f664b7440b1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2e050c2-4d60-4af8-ab76-22189c8983e3', 'serial'} {{(pid=74882) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdBPDfgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:27 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHYXSrTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:20:27 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7155MB free_disk=25.408077239990234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[10363219-843e-4314-bc00-691a78245f9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:20:27 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf4787c-3d74-417a-a728-e2d3c896711f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d] added
Nov 21 14:20:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aab948-469e-416c-9f6c-930ac41c00de]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[99553572-a61d-456f-b806-61d8eeb0e094]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdBPDfgF {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdBPDfgF" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e66da7d-e57b-4be3-9829-f8b311b1f93b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hdBPDfgF'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[245abc0c-f4b9-448d-a706-2734702c2e5c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance b33785fd-01ad-4d08-9b66-f664b7440b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance aed46662-03d4-4005-967f-56759e6dbe02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 51a5901c-6c03-4b4d-8737-8780e7224fcf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1ae17530-7c7f-48bf-a225-11be40152845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa078cb-fc96-4dd1-ac64-35cdf3400412]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[110e7910-bd79-43b8-8080-f6ced383884b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260]
Nov 21 14:20:27 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98175031-8647-4a07-ac6d-7df203d2b11e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[90490e22-5106-4678-9903-f20e5263f83b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3688e782-66ad-4565-9153-5aadb2baa5e9]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdBPDfgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23864613934326137', 'path': '/dev/sdj'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864613934326137', 'path': '/dev/sdj'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.406s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:28 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:28 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'flavor' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d300e8-fef4-43d0-a2f4-29c098c51d5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:20:28 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:20:28 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:28 user nova-compute[74882]:   <source dev="/dev/sdj"/>
Nov 21 14:20:28 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:28 user nova-compute[74882]:   <serial>94460595-2298-48c4-aff8-08cfddff270d</serial>
Nov 21 14:20:28 user nova-compute[74882]: </disk>
Nov 21 14:20:28 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.108s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0bab54-4002-4601-b6a4-88cebbf16f8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa] added
Nov 21 14:20:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef66eec4-34fa-4fdc-9818-4fb1e4bc31e7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.072s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee98597-5957-4a21-8a71-96686f4be6ca]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHYXSrTa {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHYXSrTa" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280bdcc-0608-4dbd-a8ba-b8839335cc62]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JHYXSrTa'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7befaa80-d370-488c-8dfc-48f7a5df0750]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec434eee-b836-4ef5-94af-113579d15a48]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfbe24-fcc9-4770-a2fd-afcd85b85d15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260]
Nov 21 14:20:29 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2faf223-7a3b-44a2-84ea-b9c464b9a50a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc06efc-79bc-4ea7-a439-6bfc24f3b433]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.539s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f7ce3b-08df-4355-8e36-9600f82b4053]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHYXSrTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No BDM found with device name hda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] No VIF found with MAC fa:16:3e:38:61:c9, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c23508af-1ace-46e8-9e28-5a3c05fbe68c tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.166s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.577s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] <== connect_volume: return (2984ms) {'type': 'block', 'scsi_wwn': '23466633236396438', 'path': '/dev/sdk'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466633236396438', 'path': '/dev/sdk'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.objects.instance [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lazy-loading 'flavor' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updating instance_info_cache with network_info: [{"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:20:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 114294784 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:31 user nova-compute[74882]: INFO nova.compute.manager [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Detaching volume 94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 266338304 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:32 user nova-compute[74882]: INFO nova.virt.block_device [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Attempting to driver detach volume 94460595-2298-48c4-aff8-08cfddff270d from mountpoint /dev/vdb
Nov 21 14:20:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Attempting to detach device vdb from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:20:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:32 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:32 user nova-compute[74882]:   <source dev="/dev/sdj"/>
Nov 21 14:20:32 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:32 user nova-compute[74882]:   <serial>94460595-2298-48c4-aff8-08cfddff270d</serial>
Nov 21 14:20:32 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 21 14:20:32 user nova-compute[74882]: </disk>
Nov 21 14:20:32 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:32 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully detached device vdb from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the persistent domain config.
Nov 21 14:20:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:20:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:32 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:32 user nova-compute[74882]:   <source dev="/dev/sdj"/>
Nov 21 14:20:32 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:32 user nova-compute[74882]:   <serial>94460595-2298-48c4-aff8-08cfddff270d</serial>
Nov 21 14:20:32 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 21 14:20:32 user nova-compute[74882]: </disk>
Nov 21 14:20:32 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 451936256 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:20:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 616562688 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 797966336 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:34 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41eb0e-976c-483b-aa59-4447dc153675]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:34 user nova-compute[74882]: No targets found.
Nov 21 14:20:34 user nova-compute[74882]: iSNS:
Nov 21 14:20:34 user nova-compute[74882]: No targets found.
Nov 21 14:20:34 user nova-compute[74882]: STATIC:
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb
Nov 21 14:20:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:34 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:34 user nova-compute[74882]: No targets found.
Nov 21 14:20:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:34 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:34 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[710915cb-85cb-4460-9246-5447eabc09b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6430c986-2f41-4d3c-91a5-560bb87bf14c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c5db370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3'): ({'sdg'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Removing single pathed devices sdg {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[75878150-41b1-4eb1-b647-70fa45a5a6db]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[887ea1ce-27f5-430e-bd67-58e116b2f8db]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Flushing IO for device /dev/sdg {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2fd0ef-0d69-4306-b9dd-5149bab24da3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[747672b6-8b41-4b10-98e1-d7385653bc85]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] SCSI volumes sdg have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb003d2-ece7-4422-9ca1-48f726bf418e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f7a7c-f5d3-4383-8f0c-ecb1d9fdd83f]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]
Nov 21 14:20:35 user nova-compute[74882]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:35 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-changed-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing instance network info cache due to event network-changed-77f1d830-ef25-47d5-a04a-76b7596eb24d. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Acquiring lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Acquired lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.network.neutron [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Refreshing network info cache for port 77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41ae03-c93b-4c63-a1c2-6638c3b63697]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] <== disconnect_volume: return (396ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHYXSrTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'b33785fd-01ad-4d08-9b66-f664b7440b1a', 'attached_at': '', 'detached_at': '', 'volume_id': '2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'serial'} {{(pid=74882) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] swap_volume: removing Cinder connection for volume c2e050c2-4d60-4af8-ab76-22189c8983e3 {{(pid=74882) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.network.neutron [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updated VIF entry in instance network info cache for port 77f1d830-ef25-47d5-a04a-76b7596eb24d. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.network.neutron [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c13eebde-792f-418a-8b04-ce3344d42ad8 req-6e64d88c-2187-4dc4-9e90-247d6dfb8154 service nova] Releasing lock "refresh_cache-8e29b0dc-380b-42d1-a43d-048de2d2e57b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] swap_volume: Updating volume c2e050c2-4d60-4af8-ab76-22189c8983e3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JHYXSrTa", "auth_password": "FjJwTP3eilmzHU", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "2a28eaf2-5a7c-42d2-912a-e025158f62aa"}, "status": "reserved", "instance": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "attached_at": "", "detached_at": "", "volume_id": "2a28eaf2-5a7c-42d2-912a-e025158f62aa", "serial": "2a28eaf2-5a7c-42d2-912a-e025158f62aa"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'no_device': None, 'attachment_id': '6aa5c7f5-ab5b-4903-abf3-6cd80c4e8052'} {{(pid=74882) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 21 14:20:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fd0f6e3f-1d23-4c48-944e-e04f819e3bcd tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.321s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG os_brick.utils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c989ef6-3e34-4b3e-a1b3-f62f2091cff0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950164d-151e-41eb-984e-f44ddc7ef353]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[76663418-5d90-4f81-ab9f-ae2a816a1d1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[66353f58-647c-4a41-8f71-500d06934edb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:20:36 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:20:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eecfdd-cf6a-4cb7-91a8-46b68b9d1564]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:20:36 user nova-compute[74882]: DEBUG os_brick.utils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:36 user nova-compute[74882]: INFO nova.compute.manager [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Swapping volume 2a28eaf2-5a7c-42d2-912a-e025158f62aa for c2e050c2-4d60-4af8-ab76-22189c8983e3
Nov 21 14:20:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:37 user nova-compute[74882]: INFO nova.compute.manager [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Terminating instance
Nov 21 14:20:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-unplugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-5fafadcc-4a29-4325-a483-8948b5268c65 req-09447bfa-77fb-446e-86a4-f46afc6e8528 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-77f1d830-ef25-47d5-a04a-76b7596eb24d for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-unplugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-f0d7cc02-3091-431a-afdd-94fb1285a42a req-b2eed3fb-120e-4b83-86d6-0bedf254e53b service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-2da6bd78-a4c0-4728-81e0-853c89c882fe for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-unplugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-a875feda-c68d-476e-aa38-2a11d6e1b790 req-525dc909-da8d-43cc-8f9b-5734cd689e3c service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 is timed out.
Nov 21 14:20:38 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Successfully detached device vdb from instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 from the live domain config.
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeZCUtEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:38 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ab9a9-5b1c-4892-89bd-cd022df0b4b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:38 user nova-compute[74882]: No targets found.
Nov 21 14:20:38 user nova-compute[74882]: iSNS:
Nov 21 14:20:38 user nova-compute[74882]: No targets found.
Nov 21 14:20:38 user nova-compute[74882]: STATIC:
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb
Nov 21 14:20:38 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:38 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:38 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:38 user nova-compute[74882]: No targets found.
Nov 21 14:20:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:38 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:38 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3ab40e-7ebe-47f5-97bf-8f40ce171b61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d629bde1-9516-4d7d-8c64-551b73dbcce4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:38 user nova-compute[74882]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 (non-flash)
Nov 21 14:20:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c1fdcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85'): ({'sdh'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Removing single pathed devices sdh {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf35955e-d6ad-4b03-85c5-cb2ef2d8c2e1]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b90b61-2574-47ae-8e7f-5a0215abfd53]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Flushing IO for device /dev/sdh {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e744d8ae-d681-4b48-9776-b5534f9288ad]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.033s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bfed5a-4b64-48b8-884d-e573672e554c]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] SCSI volumes sdh have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[17183404-da2b-48f7-993b-8c03b93ae1e0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[87122807-e6e7-465a-af22-46dda6a606ce]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260]
Nov 21 14:20:38 user nova-compute[74882]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55ff6ce1-10bf-4d0d-91c6-13f9fb4e8b85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e813763d-e0ed-4b31-a4db-f2f6c6a76056]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] <== disconnect_volume: return (403ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance aed46662-03d4-4005-967f-56759e6dbe02 is timed out.
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Successfully detached device sdc from instance aed46662-03d4-4005-967f-56759e6dbe02 from the live domain config.
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zYZbPfDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:39 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb73033-7fa0-4037-8e1f-0a9df8869a54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:39 user nova-compute[74882]: No targets found.
Nov 21 14:20:39 user nova-compute[74882]: iSNS:
Nov 21 14:20:39 user nova-compute[74882]: No targets found.
Nov 21 14:20:39 user nova-compute[74882]: STATIC:
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb
Nov 21 14:20:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:39 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:39 user nova-compute[74882]: No targets found.
Nov 21 14:20:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:39 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:39 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b0947e-762e-4017-b526-60a2d27c3257]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[667b1697-ea5d-4bea-b1d0-8c95c92ec304]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c1ff7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb'): ({'sdi'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Removing single pathed devices sdi {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[44edbb99-e13e-48e4-ad58-5d19d06dfbb2]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[315ca047-0424-4732-81eb-ec9f884b819f]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Flushing IO for device /dev/sdi {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9757281c-68f3-41aa-af7c-8f17b92056bd]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.126s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92cae0e-23c3-45d8-b48e-159d69488798]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] SCSI volumes sdi have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0736caa-99b6-4245-a6e3-655bc56093ad]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bab57a-4a66-47d6-bf1c-23402e1023f8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260]
Nov 21 14:20:39 user nova-compute[74882]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:39 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Instance destroyed successfully.
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lazy-loading 'resources' on Instance uuid 8e29b0dc-380b-42d1-a43d-048de2d2e57b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e1d1a23-fa97-464d-88fd-6c284804dfeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4677f8-fc0f-4f7f-9bae-70b90412db48]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.514s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] <== disconnect_volume: return (516ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:07:de,bridge_name='br-int',has_traffic_filtering=True,id=77f1d830-ef25-47d5-a04a-76b7596eb24d,network=Network(86bf0a81-542a-451d-8a26-2242103f9498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f1d830-ef') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:07:de,bridge_name='br-int',has_traffic_filtering=True,id=77f1d830-ef25-47d5-a04a-76b7596eb24d,network=Network(86bf0a81-542a-451d-8a26-2242103f9498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f1d830-ef') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f1d830-ef, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1ab6cd2-6e18-43b9-922b-4454c0b943db) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: INFO os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:07:de,bridge_name='br-int',has_traffic_filtering=True,id=77f1d830-ef25-47d5-a04a-76b7596eb24d,network=Network(86bf0a81-542a-451d-8a26-2242103f9498),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f1d830-ef')
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9b:a0,bridge_name='br-int',has_traffic_filtering=True,id=2da6bd78-a4c0-4728-81e0-853c89c882fe,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2da6bd78-a4') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9b:a0,bridge_name='br-int',has_traffic_filtering=True,id=2da6bd78-a4c0-4728-81e0-853c89c882fe,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2da6bd78-a4') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lazy-loading 'flavor' on Instance uuid 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2da6bd78-a4, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4b272a4f-7c34-410b-b001-429d76580226 tempest-VolumesAssistedSnapshotsTest-1732263514 tempest-VolumesAssistedSnapshotsTest-1732263514-project-admin] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.015s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32ccef0e-637c-4488-99be-eecadd3a37b7) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: INFO os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:9b:a0,bridge_name='br-int',has_traffic_filtering=True,id=2da6bd78-a4c0-4728-81e0-853c89c882fe,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2da6bd78-a4')
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:35:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bff0e3f-5977-4912-8998-ee250fc4ab87,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bff0e3f-59') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:35:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bff0e3f-5977-4912-8998-ee250fc4ab87,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bff0e3f-59') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bff0e3f-59, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb3a1ea3-d0c5-4f0b-b1cf-eafdff0ce006) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: INFO os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:35:b5,bridge_name='br-int',has_traffic_filtering=True,id=3bff0e3f-5977-4912-8998-ee250fc4ab87,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3bff0e3f-59')
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:79:03,bridge_name='br-int',has_traffic_filtering=True,id=33afd222-329a-46d7-81b1-f24247b83c00,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33afd222-32') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:79:03,bridge_name='br-int',has_traffic_filtering=True,id=33afd222-329a-46d7-81b1-f24247b83c00,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33afd222-32') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33afd222-32, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68bf9e9b-733b-4f4d-9ab4-e62d5699ad3f) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: INFO os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:79:03,bridge_name='br-int',has_traffic_filtering=True,id=33afd222-329a-46d7-81b1-f24247b83c00,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33afd222-32')
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e3:ef,bridge_name='br-int',has_traffic_filtering=True,id=a39dce5a-2098-4347-82f4-a79edc2b3edf,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39dce5a-20') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e3:ef,bridge_name='br-int',has_traffic_filtering=True,id=a39dce5a-2098-4347-82f4-a79edc2b3edf,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39dce5a-20') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa39dce5a-20, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60717c83-726e-4832-ae30-c95a11f06cd6) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: INFO os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:e3:ef,bridge_name='br-int',has_traffic_filtering=True,id=a39dce5a-2098-4347-82f4-a79edc2b3edf,network=Network(157a66d1-5ace-4b08-9acc-b0d8f3b37e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39dce5a-20')
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:26:42,bridge_name='br-int',has_traffic_filtering=True,id=e4ad7de7-0f3a-4611-9aea-96d24957ab96,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ad7de7-0f') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:26:42,bridge_name='br-int',has_traffic_filtering=True,id=e4ad7de7-0f3a-4611-9aea-96d24957ab96,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ad7de7-0f') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4ad7de7-0f, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bac93123-938d-4f27-8d41-1cffb9dd7c67) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: INFO os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:26:42,bridge_name='br-int',has_traffic_filtering=True,id=e4ad7de7-0f3a-4611-9aea-96d24957ab96,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ad7de7-0f')
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-43172401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-43172401',id=10,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1tEQSY+VEcKyKXdYKTGqkIfDOZmsyjeDAEKue92+2TpjA00u7sVtsnvl5XLRfPmPGBWD5yg7mXHQEzH9YH6I2v6/7204lrS/gRPzLFKwrrU99YwooOxwjrIN4RNyas7A==',key_name='tempest-keypair-1419935771',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e3715d8166472e843d6a046fc819c6',ramdisk_id='',reservation_id='r-z5rwe3k9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-613847140',owner_user_name='tempest-TaggedBootDevicesTest_v242-613847140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80a5b85d5cdf4f8c9fb662c6e04b74fb',uuid=8e29b0dc-380b-42d1-a43d-048de2d2e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converting VIF {"id": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "address": "fa:16:3e:a8:64:1c", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc19bf1d-6c", "ovs_interfaceid": "dc19bf1d-6c50-486a-952c-3b3d067409f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:64:1c,bridge_name='br-int',has_traffic_filtering=True,id=dc19bf1d-6c50-486a-952c-3b3d067409f7,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc19bf1d-6c') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:64:1c,bridge_name='br-int',has_traffic_filtering=True,id=dc19bf1d-6c50-486a-952c-3b3d067409f7,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc19bf1d-6c') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc19bf1d-6c, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-77f1d830-ef25-47d5-a04a-76b7596eb24d for instance with vm_state active and task_state deleting.
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-unplugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-33afd222-329a-46d7-81b1-f24247b83c00 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-33afd222-329a-46d7-81b1-f24247b83c00 for instance with vm_state active and task_state deleting.
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-unplugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-a39dce5a-2098-4347-82f4-a79edc2b3edf for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-a39dce5a-2098-4347-82f4-a79edc2b3edf for instance with vm_state active and task_state deleting.
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-unplugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING nova.compute.manager [req-532a9243-1fdb-44dc-b1f1-53c1543c66f8 req-f29cc7a1-caad-47e4-a4cd-6ef817093a17 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-dc19bf1d-6c50-486a-952c-3b3d067409f7 for instance with vm_state active and task_state deleting.
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f18b484-1024-4397-a0a8-1e7fb19d9d5b) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:40 user nova-compute[74882]: INFO os_vif [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:64:1c,bridge_name='br-int',has_traffic_filtering=True,id=dc19bf1d-6c50-486a-952c-3b3d067409f7,network=Network(59a1c4b3-1c8c-490d-a38a-10ccbd751e63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc19bf1d-6c')
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRKWPAMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[50402bbd-b937-4133-bd03-b0fa7f3baa56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:40 user nova-compute[74882]: No targets found.
Nov 21 14:20:40 user nova-compute[74882]: iSNS:
Nov 21 14:20:40 user nova-compute[74882]: No targets found.
Nov 21 14:20:40 user nova-compute[74882]: STATIC:
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:40 user nova-compute[74882]: No targets found.
Nov 21 14:20:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:40 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:40 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-3bff0e3f-5977-4912-8998-ee250fc4ab87 for instance with vm_state active and task_state deleting.
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-unplugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-unplugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING nova.compute.manager [req-b003743f-35f8-4d93-8b67-cee07e1bfdae req-f1a0ea7c-3d4e-4dff-a774-53302a1eb17a service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-e4ad7de7-0f3a-4611-9aea-96d24957ab96 for instance with vm_state active and task_state deleting.
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[91894e98-a1ce-4b96-9db2-c38b6c61cea6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Acquiring lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] No waiting events found dispatching network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING nova.compute.manager [req-2082b78a-599b-4358-ab0e-6480b5ede961 req-87563289-a9dd-4b8a-8f79-d67d9e36440d service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received unexpected event network-vif-plugged-2da6bd78-a4c0-4728-81e0-853c89c882fe for instance with vm_state active and task_state deleting.
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf3c1f4-6d7c-40d9-a372-3bc2e6556c70]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c38a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lazy-loading 'flavor' on Instance uuid aed46662-03d4-4005-967f-56759e6dbe02 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14cd4a-6a37-4099-b609-ec70aba79b48]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f13a74b8-6bbc-4206-a2ea-e1b8f900e5e2 tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.995s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5887350b-2e6c-4214-b588-fe9bfac8e06a]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3581bc70-7a36-4d9a-9040-7b0e4c5157a1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7d4c8e-f559-4320-b8ca-f3a3a87054be]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[35caed88-bc22-4881-b97f-20bb248a02d1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a936990-bdc9-46b1-ac53-79168d460502]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260]
Nov 21 14:20:40 user nova-compute[74882]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61b0d03a-6007-4a40-858a-33490851ad91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bcb925-1a6d-4009-b03b-04cc13f72eb8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== disconnect_volume: return (388ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcXLRMqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:40 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb064fe6-01f4-4225-98dc-fee63e02ac84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:40 user nova-compute[74882]: No targets found.
Nov 21 14:20:40 user nova-compute[74882]: iSNS:
Nov 21 14:20:40 user nova-compute[74882]: No targets found.
Nov 21 14:20:40 user nova-compute[74882]: STATIC:
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93
Nov 21 14:20:40 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:40 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:40 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:40 user nova-compute[74882]: No targets found.
Nov 21 14:20:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:40 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:40 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16dbd32-86c8-4701-8567-925962ecd8fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8399e82-0ca9-4e74-9449-ebdbb0cfa760]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:40 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c5d93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35e0fb7-1737-496d-8b0d-c56f98daf2c5]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c5d43-bcbc-45e5-a16a-270f0bbde01e]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e22905d-fd80-46da-9c2b-365410a6cc90]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d33f581-77b7-4326-9718-c1af70b3f182]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada15a58-e220-4efa-97b0-228049ba8d98]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[921282fc-d1d9-42f5-bbaa-ced8c4821f2d]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260]
Nov 21 14:20:41 user nova-compute[74882]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:41 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51ffdcef-a58a-4101-a967-2a66ec25ad93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[32887115-a3a6-4a27-a6e2-5e909edaca97]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== disconnect_volume: return (323ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARpTUqPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:41 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d3cb2-44c9-4f72-ab13-190913084342]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:41 user nova-compute[74882]: No targets found.
Nov 21 14:20:41 user nova-compute[74882]: iSNS:
Nov 21 14:20:41 user nova-compute[74882]: No targets found.
Nov 21 14:20:41 user nova-compute[74882]: STATIC:
Nov 21 14:20:41 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1
Nov 21 14:20:41 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:41 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:41 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:41 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:41 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:41 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:41 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:41 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:41 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:41 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:41 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:41 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:41 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:41 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:41 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:41 user nova-compute[74882]: No targets found.
Nov 21 14:20:41 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:41 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:41 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c37336-3b6a-4e1e-b961-dfade93436ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ddb59d-d14b-47b3-bf15-bbd9aa2ee49f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:41 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:41 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:41 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c5d93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b11dd20-4b34-48fb-a60a-cb94fe5e092b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2756b-7bfa-4b9b-aabc-488dc86b04ae]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aa772d-dd45-4313-80d6-15b936efe87f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e18483-3382-43fa-bac2-751bfd19cdf7]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e15b9c-b80d-49ac-a6bc-447a9d67bdd7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5ca210-df25-48e8-9e56-a1dd19cf9902]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260]
Nov 21 14:20:41 user nova-compute[74882]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:41 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edecdce9-a757-4671-8c6f-72b9d5048db1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff99b7-4be1-48cf-8284-8e51bebb8369]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] <== disconnect_volume: return (327ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Deleting instance files /opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b_del
Nov 21 14:20:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Deletion of /opt/stack/data/nova/instances/8e29b0dc-380b-42d1-a43d-048de2d2e57b_del complete
Nov 21 14:20:41 user nova-compute[74882]: INFO nova.compute.manager [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Took 3.86 seconds to destroy the instance on the hypervisor.
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:20:41 user nova-compute[74882]: INFO nova.compute.manager [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Terminating instance
Nov 21 14:20:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Instance destroyed successfully.
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lazy-loading 'resources' on Instance uuid aed46662-03d4-4005-967f-56759e6dbe02 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:17:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1065534804',display_name='tempest-AttachSCSIVolumeTestJSON-server-1065534804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1065534804',id=7,image_ref='390b3cc6-3bd3-4725-8892-588039943890',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNovnpySsk3U0Q8+6LE0jiFBVTtkEvGsSDriJ5AOb/mzU9zamNWZhEW+zvPNYWK/cq/0aVIY6jPkY2qVS+L+dk7lkr/cLCQgfbWINSCyPIASxIiL1t7Y3W5GSsYQulzqMA==',key_name='tempest-keypair-2090548767',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff93a19129c54087a14dde51cdd7b4dc',ramdisk_id='',reservation_id='r-j7fcny9l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='390b3cc6-3bd3-4725-8892-588039943890',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-140131820',owner_user_name='tempest-AttachSCSIVolumeTestJSON-140131820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9642feeb69a74dec89b9123a2afb4bba',uuid=aed46662-03d4-4005-967f-56759e6dbe02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Converting VIF {"id": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "address": "fa:16:3e:75:d0:99", "network": {"id": "ac66118d-d7f7-4ea5-9867-17c6981992ab", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1268795184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff93a19129c54087a14dde51cdd7b4dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0b8b24e-ec", "ovs_interfaceid": "a0b8b24e-ecbb-44f4-a461-da537be0c5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:d0:99,bridge_name='br-int',has_traffic_filtering=True,id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1,network=Network(ac66118d-d7f7-4ea5-9867-17c6981992ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8b24e-ec') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG os_vif [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:d0:99,bridge_name='br-int',has_traffic_filtering=True,id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1,network=Network(ac66118d-d7f7-4ea5-9867-17c6981992ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8b24e-ec') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0b8b24e-ec, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8b13bfe-0f7d-412a-912d-e8b7f572c0aa) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:42 user nova-compute[74882]: INFO os_vif [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:d0:99,bridge_name='br-int',has_traffic_filtering=True,id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1,network=Network(ac66118d-d7f7-4ea5-9867-17c6981992ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0b8b24e-ec')
Nov 21 14:20:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Deleting instance files /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02_del
Nov 21 14:20:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Deletion of /opt/stack/data/nova/instances/aed46662-03d4-4005-967f-56759e6dbe02_del complete
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.compute.manager [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-vif-unplugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.compute.manager [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] No waiting events found dispatching network-vif-unplugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.compute.manager [req-9b4fdc69-b601-4475-b27a-06648576f026 req-d4ac92c2-1a91-4fc6-a498-4ba3d0cba742 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-vif-unplugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:20:42 user nova-compute[74882]: INFO nova.compute.manager [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 21 14:20:42 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:20:42 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: aed46662-03d4-4005-967f-56759e6dbe02] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:43 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Took 1.03 seconds to deallocate network for instance.
Nov 21 14:20:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-vif-deleted-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:43 user nova-compute[74882]: INFO nova.compute.manager [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Neutron deleted interface a0b8b24e-ecbb-44f4-a461-da537be0c5d1; detaching it from the instance and deleting it from the info cache
Nov 21 14:20:43 user nova-compute[74882]: DEBUG nova.network.neutron [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-38de5f16-d986-4b07-8250-ca23d0bfbb67 req-e1529cef-bc5b-40cc-bd99-6979cde0a537 service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Detach interface failed, port_id=a0b8b24e-ecbb-44f4-a461-da537be0c5d1, reason: Instance aed46662-03d4-4005-967f-56759e6dbe02 could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b33785fd-01ad-4d08-9b66-f664b7440b1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2e050c2-4d60-4af8-ab76-22189c8983e3', 'serial': 'c2e050c2-4d60-4af8-ab76-22189c8983e3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHYXSrTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '2a28eaf2-5a7c-42d2-912a-e025158f62aa'}, 'status': 'reserved', 'instance': 'b33785fd-01ad-4d08-9b66-f664b7440b1a', 'attached_at': '', 'detached_at': '', 'volume_id': '2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'serial'} {{(pid=74882) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:43 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:43 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:43 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:20:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2aa388-f6d8-4888-9539-e0b1ff9a54fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:20:43 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f4c1d4-e5fe-404b-a76f-d572db1961b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3] added
Nov 21 14:20:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5791e53-6a58-4923-a092-6ce3c34d1e39]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe9665-c84a-42bf-97e4-33d2ca42eb12]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsxbGZkF {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsxbGZkF" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c466cbb-3369-4965-bc16-6b8a58259dce]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wsxbGZkF'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Deleted allocations for instance aed46662-03d4-4005-967f-56759e6dbe02
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d9a79-8841-4aa3-a01d-46f570174629]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a4323b-8214-4a0b-89f6-9bacc3878ea7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a4bcaeb0-935e-4bb0-a647-6416b9bab37e tempest-AttachSCSIVolumeTestJSON-140131820 tempest-AttachSCSIVolumeTestJSON-140131820-project-member] Lock "aed46662-03d4-4005-967f-56759e6dbe02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.582s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec7a5e-68a5-4d21-8537-d2da00ac2f81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]
Nov 21 14:20:44 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d236652c-0dd3-43cc-a2a3-be4f3f7bfe32]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4224b6b5-26dc-4819-ba23-65d99c10678e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:44 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc81a60-cdb4-488a-8adb-10716a314825]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received event network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Acquiring lock "aed46662-03d4-4005-967f-56759e6dbe02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] Lock "aed46662-03d4-4005-967f-56759e6dbe02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] No waiting events found dispatching network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:44 user nova-compute[74882]: WARNING nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: aed46662-03d4-4005-967f-56759e6dbe02] Received unexpected event network-vif-plugged-a0b8b24e-ecbb-44f4-a461-da537be0c5d1 for instance with vm_state deleted and task_state None.
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-deleted-dc19bf1d-6c50-486a-952c-3b3d067409f7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:44 user nova-compute[74882]: INFO nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Neutron deleted interface dc19bf1d-6c50-486a-952c-3b3d067409f7; detaching it from the instance and deleting it from the info cache
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33afd222-329a-46d7-81b1-f24247b83c00", "address": "fa:16:3e:f9:79:03", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33afd222-32", "ovs_interfaceid": "33afd222-329a-46d7-81b1-f24247b83c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Detach interface failed, port_id=dc19bf1d-6c50-486a-952c-3b3d067409f7, reason: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-deleted-33afd222-329a-46d7-81b1-f24247b83c00 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:44 user nova-compute[74882]: INFO nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Neutron deleted interface 33afd222-329a-46d7-81b1-f24247b83c00; detaching it from the instance and deleting it from the info cache
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [{"id": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "address": "fa:16:3e:1a:07:de", "network": {"id": "86bf0a81-542a-451d-8a26-2242103f9498", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1792807326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f1d830-ef", "ovs_interfaceid": "77f1d830-ef25-47d5-a04a-76b7596eb24d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "address": "fa:16:3e:b2:9b:a0", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2da6bd78-a4", "ovs_interfaceid": "2da6bd78-a4c0-4728-81e0-853c89c882fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "address": "fa:16:3e:70:35:b5", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bff0e3f-59", "ovs_interfaceid": "3bff0e3f-5977-4912-8998-ee250fc4ab87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "address": "fa:16:3e:b6:e3:ef", "network": {"id": "157a66d1-5ace-4b08-9acc-b0d8f3b37e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-740582860", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39dce5a-20", "ovs_interfaceid": "a39dce5a-2098-4347-82f4-a79edc2b3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "address": "fa:16:3e:27:26:42", "network": {"id": "59a1c4b3-1c8c-490d-a38a-10ccbd751e63", "bridge": "br-int", "label": "tempest-device-tagging-net2-580544823", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76e3715d8166472e843d6a046fc819c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ad7de7-0f", "ovs_interfaceid": "e4ad7de7-0f3a-4611-9aea-96d24957ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-25bb7606-e833-4764-bdab-d4b3884a9f34 req-4a0b4c2e-9ce4-48c1-a1e4-4c5d864e5dcb service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Detach interface failed, port_id=33afd222-329a-46d7-81b1-f24247b83c00, reason: Instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:20:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26364626234323335', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364626234323335', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:20:45 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lazy-loading 'flavor' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:46 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:20:46 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Took 4.52 seconds to deallocate network for instance.
Nov 21 14:20:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 114294784 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-deleted-77f1d830-ef25-47d5-a04a-76b7596eb24d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-deleted-e4ad7de7-0f3a-4611-9aea-96d24957ab96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-9df7e6c7-f77c-484f-9d62-11aa4b2828cc req-052e06fb-1b39-4865-a150-fa582aa8c313 service nova] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Received event network-vif-deleted-a39dce5a-2098-4347-82f4-a79edc2b3edf {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 269484032 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 417333248 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 576716800 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 710934528 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 815792128 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 993001472 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:49 user nova-compute[74882]: INFO nova.compute.manager [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] [instance: 8e29b0dc-380b-42d1-a43d-048de2d2e57b] Took 3.26 seconds to detach 3 volumes for instance.
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:49 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Deleted allocations for instance 8e29b0dc-380b-42d1-a43d-048de2d2e57b
Nov 21 14:20:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHYXSrTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '2a28eaf2-5a7c-42d2-912a-e025158f62aa'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[52368eb1-9858-472e-a5f9-9d1922d20e3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:49 user nova-compute[74882]: No targets found.
Nov 21 14:20:49 user nova-compute[74882]: iSNS:
Nov 21 14:20:49 user nova-compute[74882]: No targets found.
Nov 21 14:20:49 user nova-compute[74882]: STATIC:
Nov 21 14:20:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3
Nov 21 14:20:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa
Nov 21 14:20:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:49 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:49 user nova-compute[74882]: No targets found.
Nov 21 14:20:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:49 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:49 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57dd785-b4e8-4da3-ae46-ad58983a2d06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c19dfc-3329-4529-9752-40d80f500e57]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:50 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c692830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa'): ({'sdk'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Removing single pathed devices sdk {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fe591ace-43da-4a88-83fe-a45e851b161c tempest-TaggedBootDevicesTest_v242-613847140 tempest-TaggedBootDevicesTest_v242-613847140-project-member] Lock "8e29b0dc-380b-42d1-a43d-048de2d2e57b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.297s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a5adf5-33f6-4f6f-8e30-72616ae36483]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcdb59b-c0d2-4b82-bdf7-eee26533a0fb]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Flushing IO for device /dev/sdk {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[da08e1fc-ddd8-425f-9d1c-9be773dcdd99]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.067s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d6d503-fbbd-4715-8351-f370ce583990]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] SCSI volumes sdk have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fee8f7-e818-4ba8-9343-b18b3f8ceba1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[522388c2-a82a-4481-b8cf-17f1ab6ce815]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260]
Nov 21 14:20:50 user nova-compute[74882]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a28eaf2-5a7c-42d2-912a-e025158f62aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daa0263-3985-49e1-9d42-82d3222fabc1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] <== disconnect_volume: return (370ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b33785fd-01ad-4d08-9b66-f664b7440b1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2e050c2-4d60-4af8-ab76-22189c8983e3', 'serial'} {{(pid=74882) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 21 14:20:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] swap_volume: removing Cinder connection for volume 2a28eaf2-5a7c-42d2-912a-e025158f62aa {{(pid=74882) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 21 14:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] swap_volume: Updating volume 2a28eaf2-5a7c-42d2-912a-e025158f62aa BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "wsxbGZkF", "auth_password": "xLPd2EhHuZeCnF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "c2e050c2-4d60-4af8-ab76-22189c8983e3"}, "status": "reserved", "instance": "b33785fd-01ad-4d08-9b66-f664b7440b1a", "attached_at": "", "detached_at": "", "volume_id": "c2e050c2-4d60-4af8-ab76-22189c8983e3", "serial": "c2e050c2-4d60-4af8-ab76-22189c8983e3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c2e050c2-4d60-4af8-ab76-22189c8983e3', 'no_device': None, 'attachment_id': '8269bfd8-4b65-4138-8784-1629462c3220'} {{(pid=74882) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 21 14:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e586f9f2-a58b-4bf4-91ba-5ae8361bc103 tempest-TestVolumeSwap-912196140 tempest-TestVolumeSwap-912196140-project-admin] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.445s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:52 user nova-compute[74882]: INFO nova.compute.manager [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Detaching volume c2e050c2-4d60-4af8-ab76-22189c8983e3
Nov 21 14:20:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:52 user nova-compute[74882]: INFO nova.virt.block_device [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Attempting to driver detach volume c2e050c2-4d60-4af8-ab76-22189c8983e3 from mountpoint /dev/vdb
Nov 21 14:20:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Attempting to detach device vdb from instance b33785fd-01ad-4d08-9b66-f664b7440b1a from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:52 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:52 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:20:52 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:52 user nova-compute[74882]:   <serial>c2e050c2-4d60-4af8-ab76-22189c8983e3</serial>
Nov 21 14:20:52 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:20:52 user nova-compute[74882]: </disk>
Nov 21 14:20:52 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:52 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Successfully detached device vdb from instance b33785fd-01ad-4d08-9b66-f664b7440b1a from the persistent domain config.
Nov 21 14:20:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b33785fd-01ad-4d08-9b66-f664b7440b1a from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:20:52 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:20:52 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:20:52 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:20:52 user nova-compute[74882]:   <serial>c2e050c2-4d60-4af8-ab76-22189c8983e3</serial>
Nov 21 14:20:52 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:20:52 user nova-compute[74882]: </disk>
Nov 21 14:20:52 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:52 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 is timed out.
Nov 21 14:20:52 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully detached device vdb from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the live domain config.
Nov 21 14:20:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdBPDfgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:20:52 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bca53a-9aea-4c6a-9864-e20a5c39bb9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:20:52 user nova-compute[74882]: No targets found.
Nov 21 14:20:52 user nova-compute[74882]: iSNS:
Nov 21 14:20:52 user nova-compute[74882]: No targets found.
Nov 21 14:20:52 user nova-compute[74882]: STATIC:
Nov 21 14:20:52 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:20:52 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:52 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:52 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d
Nov 21 14:20:52 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:52 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:52 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:20:52 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:52 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:52 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3
Nov 21 14:20:52 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:20:52 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:20:52 user nova-compute[74882]: FIRMWARE:
Nov 21 14:20:52 user nova-compute[74882]: No targets found.
Nov 21 14:20:52 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:20:52 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:20:52 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89adf82-bdec-4d36-830c-641bd085e5af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b97a1ae-7d48-42c1-8f58-c35d992c2257]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:52 user nova-compute[74882]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:52 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:52 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:52 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d (non-flash)
Nov 21 14:20:52 user nova-compute[74882]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:20:52 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:20:52 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:20:52 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c732170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d'): ({'sdj'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Removing single pathed devices sdj {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73f8f98-1f39-4a87-afa2-cbf8f7e10a82]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[458ea597-8b20-486f-93c0-e908f6b73b73]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Flushing IO for device /dev/sdj {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7925e1-8050-4215-aaa6-3b4a622e5ae8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad9912e-56bf-4268-88dc-7f1a6d964b5d]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] SCSI volumes sdj have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2addd9-cab5-44f6-abbc-4e2ded8b65b6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f666c7-bbd4-4ad5-97e2-853c23a17692]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260]
Nov 21 14:20:52 user nova-compute[74882]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d, portal: 172.16.0.220,3260] successful.
Nov 21 14:20:52 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94460595-2298-48c4-aff8-08cfddff270d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb91cbe5-2548-4552-a992-76c0c53dfed7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] <== disconnect_volume: return (344ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:20:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:20:53 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'flavor' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5810bed3-8ebc-4c3e-b322-d64b9a95cd61 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.023s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "interface-4deaafad-f14d-4525-acaf-1ff5986f3db0-72906f62-8c9d-4af7-9a8d-06fa07fe7950" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "interface-4deaafad-f14d-4525-acaf-1ff5986f3db0-72906f62-8c9d-4af7-9a8d-06fa07fe7950" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'flavor' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1480492247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1480492247',id=9,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA==',key_name='tempest-keypair-733819265',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1525a2b149ed40f9b3bbd98d1792a84c',ramdisk_id='',reservation_id='r-jjuy5qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-607886265',owner_user_name='tempest-TaggedAttachmentsTest-607886265-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0c9acb0c4a42beb3c41ba4ab44c4a8',uuid=4deaafad-f14d-4525-acaf-1ff5986f3db0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converting VIF {"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:5e:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap72906f62-8c"/></interface> {{(pid=74882) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:5e:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap72906f62-8c"/></interface> {{(pid=74882) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Attempting to detach device tap72906f62-8c from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] detach device xml: <interface type="ethernet">
Nov 21 14:20:54 user nova-compute[74882]:   <mac address="fa:16:3e:d8:5e:7f"/>
Nov 21 14:20:54 user nova-compute[74882]:   <model type="virtio"/>
Nov 21 14:20:54 user nova-compute[74882]:   <mtu size="1442"/>
Nov 21 14:20:54 user nova-compute[74882]:   <target dev="tap72906f62-8c"/>
Nov 21 14:20:54 user nova-compute[74882]: </interface>
Nov 21 14:20:54 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:5e:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap72906f62-8c"/></interface> {{(pid=74882) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:5e:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap72906f62-8c"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 21 14:20:54 user nova-compute[74882]:   <name>instance-00000009</name>
Nov 21 14:20:54 user nova-compute[74882]:   <uuid>4deaafad-f14d-4525-acaf-1ff5986f3db0</uuid>
Nov 21 14:20:54 user nova-compute[74882]:   <metadata>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:20:54 user nova-compute[74882]:   <nova:package version="0.0.0"/>
Nov 21 14:20:54 user nova-compute[74882]:   <nova:name>tempest-device-tagging-server-1480492247</nova:name>
Nov 21 14:20:54 user nova-compute[74882]:   <nova:creationTime>2023-11-21 14:20:00</nova:creationTime>
Nov 21 14:20:54 user nova-compute[74882]:   <nova:flavor name="m1.tiny">
Nov 21 14:20:54 user nova-compute[74882]:     <nova:memory>512</nova:memory>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:disk>1</nova:disk>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:swap>0</nova:swap>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:vcpus>1</nova:vcpus>
Nov 21 14:20:54 user nova-compute[74882]:   </nova:flavor>
Nov 21 14:20:54 user nova-compute[74882]:   <nova:owner>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:user uuid="ed0c9acb0c4a42beb3c41ba4ab44c4a8">tempest-TaggedAttachmentsTest-607886265-project-member</nova:user>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:project uuid="1525a2b149ed40f9b3bbd98d1792a84c">tempest-TaggedAttachmentsTest-607886265</nova:project>
Nov 21 14:20:54 user nova-compute[74882]:   </nova:owner>
Nov 21 14:20:54 user nova-compute[74882]:   <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:20:54 user nova-compute[74882]:   <nova:ports>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:port uuid="eba59df5-fece-4e7b-923c-3fd0f0a8c6cd">
Nov 21 14:20:54 user nova-compute[74882]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:20:54 user nova-compute[74882]:     </nova:port>
Nov 21 14:20:54 user nova-compute[74882]:     <nova:port uuid="72906f62-8c9d-4af7-9a8d-06fa07fe7950">
Nov 21 14:20:54 user nova-compute[74882]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Nov 21 14:20:54 user nova-compute[74882]:     </nova:port>
Nov 21 14:20:54 user nova-compute[74882]:   </nova:ports>
Nov 21 14:20:54 user nova-compute[74882]: </nova:instance>
Nov 21 14:20:54 user nova-compute[74882]:   </metadata>
Nov 21 14:20:54 user nova-compute[74882]:   <memory unit='KiB'>524288</memory>
Nov 21 14:20:54 user nova-compute[74882]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 21 14:20:54 user nova-compute[74882]:   <vcpu placement='static'>1</vcpu>
Nov 21 14:20:54 user nova-compute[74882]:   <resource>
Nov 21 14:20:54 user nova-compute[74882]:     <partition>/machine</partition>
Nov 21 14:20:54 user nova-compute[74882]:   </resource>
Nov 21 14:20:54 user nova-compute[74882]:   <sysinfo type='smbios'>
Nov 21 14:20:54 user nova-compute[74882]:     <system>
Nov 21 14:20:54 user nova-compute[74882]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 21 14:20:54 user nova-compute[74882]:       <entry name='product'>OpenStack Nova</entry>
Nov 21 14:20:54 user nova-compute[74882]:       <entry name='version'>0.0.0</entry>
Nov 21 14:20:54 user nova-compute[74882]:       <entry name='serial'>4deaafad-f14d-4525-acaf-1ff5986f3db0</entry>
Nov 21 14:20:54 user nova-compute[74882]:       <entry name='uuid'>4deaafad-f14d-4525-acaf-1ff5986f3db0</entry>
Nov 21 14:20:54 user nova-compute[74882]:       <entry name='family'>Virtual Machine</entry>
Nov 21 14:20:54 user nova-compute[74882]:     </system>
Nov 21 14:20:54 user nova-compute[74882]:   </sysinfo>
Nov 21 14:20:54 user nova-compute[74882]:   <os>
Nov 21 14:20:54 user nova-compute[74882]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 21 14:20:54 user nova-compute[74882]:     <boot dev='hd'/>
Nov 21 14:20:54 user nova-compute[74882]:     <smbios mode='sysinfo'/>
Nov 21 14:20:54 user nova-compute[74882]:   </os>
Nov 21 14:20:54 user nova-compute[74882]:   <features>
Nov 21 14:20:54 user nova-compute[74882]:     <acpi/>
Nov 21 14:20:54 user nova-compute[74882]:     <apic/>
Nov 21 14:20:54 user nova-compute[74882]:     <vmcoreinfo state='on'/>
Nov 21 14:20:54 user nova-compute[74882]:   </features>
Nov 21 14:20:54 user nova-compute[74882]:   <cpu mode='custom' match='exact' check='full'>
Nov 21 14:20:54 user nova-compute[74882]:     <model fallback='forbid'>Nehalem</model>
Nov 21 14:20:54 user nova-compute[74882]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 21 14:20:54 user nova-compute[74882]:     <feature policy='require' name='vme'/>
Nov 21 14:20:54 user nova-compute[74882]:     <feature policy='require' name='x2apic'/>
Nov 21 14:20:54 user nova-compute[74882]:     <feature policy='require' name='hypervisor'/>
Nov 21 14:20:54 user nova-compute[74882]:   </cpu>
Nov 21 14:20:54 user nova-compute[74882]:   <clock offset='utc'>
Nov 21 14:20:54 user nova-compute[74882]:     <timer name='pit' tickpolicy='delay'/>
Nov 21 14:20:54 user nova-compute[74882]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 21 14:20:54 user nova-compute[74882]:     <timer name='hpet' present='no'/>
Nov 21 14:20:54 user nova-compute[74882]:   </clock>
Nov 21 14:20:54 user nova-compute[74882]:   <on_poweroff>destroy</on_poweroff>
Nov 21 14:20:54 user nova-compute[74882]:   <on_reboot>restart</on_reboot>
Nov 21 14:20:54 user nova-compute[74882]:   <on_crash>destroy</on_crash>
Nov 21 14:20:54 user nova-compute[74882]:   <devices>
Nov 21 14:20:54 user nova-compute[74882]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 21 14:20:54 user nova-compute[74882]:     <disk type='file' device='disk'>
Nov 21 14:20:54 user nova-compute[74882]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 21 14:20:54 user nova-compute[74882]:       <source file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk' index='2'/>
Nov 21 14:20:54 user nova-compute[74882]:       <backingStore type='file' index='3'>
Nov 21 14:20:54 user nova-compute[74882]:         <format type='raw'/>
Nov 21 14:20:54 user nova-compute[74882]:         <source file='/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d'/>
Nov 21 14:20:54 user nova-compute[74882]:         <backingStore/>
Nov 21 14:20:54 user nova-compute[74882]:       </backingStore>
Nov 21 14:20:54 user nova-compute[74882]:       <target dev='vda' bus='virtio'/>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='virtio-disk0'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </disk>
Nov 21 14:20:54 user nova-compute[74882]:     <disk type='file' device='cdrom'>
Nov 21 14:20:54 user nova-compute[74882]:       <driver name='qemu' type='raw' cache='none'/>
Nov 21 14:20:54 user nova-compute[74882]:       <source file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.config' index='1'/>
Nov 21 14:20:54 user nova-compute[74882]:       <backingStore/>
Nov 21 14:20:54 user nova-compute[74882]:       <target dev='hda' bus='ide'/>
Nov 21 14:20:54 user nova-compute[74882]:       <readonly/>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='ide0-0-0'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </disk>
Nov 21 14:20:54 user nova-compute[74882]:     <controller type='usb' index='0' model='none'>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='usb'/>
Nov 21 14:20:54 user nova-compute[74882]:     </controller>
Nov 21 14:20:54 user nova-compute[74882]:     <controller type='pci' index='0' model='pci-root'>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='pci.0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </controller>
Nov 21 14:20:54 user nova-compute[74882]:     <controller type='ide' index='0'>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='ide'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 21 14:20:54 user nova-compute[74882]:     </controller>
Nov 21 14:20:54 user nova-compute[74882]:     <interface type='ethernet'>
Nov 21 14:20:54 user nova-compute[74882]:       <mac address='fa:16:3e:38:61:c9'/>
Nov 21 14:20:54 user nova-compute[74882]:       <target dev='tapeba59df5-fe'/>
Nov 21 14:20:54 user nova-compute[74882]:       <model type='virtio'/>
Nov 21 14:20:54 user nova-compute[74882]:       <mtu size='1442'/>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='net0'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </interface>
Nov 21 14:20:54 user nova-compute[74882]:     <interface type='ethernet'>
Nov 21 14:20:54 user nova-compute[74882]:       <mac address='fa:16:3e:d8:5e:7f'/>
Nov 21 14:20:54 user nova-compute[74882]:       <target dev='tap72906f62-8c'/>
Nov 21 14:20:54 user nova-compute[74882]:       <model type='virtio'/>
Nov 21 14:20:54 user nova-compute[74882]:       <mtu size='1442'/>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='net1'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </interface>
Nov 21 14:20:54 user nova-compute[74882]:     <serial type='pty'>
Nov 21 14:20:54 user nova-compute[74882]:       <source path='/dev/pts/8'/>
Nov 21 14:20:54 user nova-compute[74882]:       <log file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/console.log' append='off'/>
Nov 21 14:20:54 user nova-compute[74882]:       <target type='isa-serial' port='0'>
Nov 21 14:20:54 user nova-compute[74882]:         <model name='isa-serial'/>
Nov 21 14:20:54 user nova-compute[74882]:       </target>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='serial0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </serial>
Nov 21 14:20:54 user nova-compute[74882]:     <console type='pty' tty='/dev/pts/8'>
Nov 21 14:20:54 user nova-compute[74882]:       <source path='/dev/pts/8'/>
Nov 21 14:20:54 user nova-compute[74882]:       <log file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/console.log' append='off'/>
Nov 21 14:20:54 user nova-compute[74882]:       <target type='serial' port='0'/>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='serial0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </console>
Nov 21 14:20:54 user nova-compute[74882]:     <input type='mouse' bus='ps2'>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='input0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </input>
Nov 21 14:20:54 user nova-compute[74882]:     <input type='keyboard' bus='ps2'>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='input1'/>
Nov 21 14:20:54 user nova-compute[74882]:     </input>
Nov 21 14:20:54 user nova-compute[74882]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 21 14:20:54 user nova-compute[74882]:       <listen type='address' address='0.0.0.0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </graphics>
Nov 21 14:20:54 user nova-compute[74882]:     <audio id='1' type='none'/>
Nov 21 14:20:54 user nova-compute[74882]:     <video>
Nov 21 14:20:54 user nova-compute[74882]:       <model type='virtio' heads='1' primary='yes'/>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='video0'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </video>
Nov 21 14:20:54 user nova-compute[74882]:     <memballoon model='virtio'>
Nov 21 14:20:54 user nova-compute[74882]:       <stats period='10'/>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='balloon0'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </memballoon>
Nov 21 14:20:54 user nova-compute[74882]:     <rng model='virtio'>
Nov 21 14:20:54 user nova-compute[74882]:       <backend model='random'>/dev/urandom</backend>
Nov 21 14:20:54 user nova-compute[74882]:       <alias name='rng0'/>
Nov 21 14:20:54 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 21 14:20:54 user nova-compute[74882]:     </rng>
Nov 21 14:20:54 user nova-compute[74882]:   </devices>
Nov 21 14:20:54 user nova-compute[74882]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 21 14:20:54 user nova-compute[74882]:     <label>libvirt-4deaafad-f14d-4525-acaf-1ff5986f3db0</label>
Nov 21 14:20:54 user nova-compute[74882]:     <imagelabel>libvirt-4deaafad-f14d-4525-acaf-1ff5986f3db0</imagelabel>
Nov 21 14:20:54 user nova-compute[74882]:   </seclabel>
Nov 21 14:20:54 user nova-compute[74882]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 21 14:20:54 user nova-compute[74882]:     <label>+64055:+108</label>
Nov 21 14:20:54 user nova-compute[74882]:     <imagelabel>+64055:+108</imagelabel>
Nov 21 14:20:54 user nova-compute[74882]:   </seclabel>
Nov 21 14:20:54 user nova-compute[74882]: </domain>
Nov 21 14:20:54 user nova-compute[74882]:  {{(pid=74882) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 21 14:20:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully detached device tap72906f62-8c from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the persistent domain config.
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] (1/8): Attempting to detach device tap72906f62-8c with device alias net1 from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:20:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] detach device xml: <interface type="ethernet">
Nov 21 14:20:54 user nova-compute[74882]:   <mac address="fa:16:3e:d8:5e:7f"/>
Nov 21 14:20:54 user nova-compute[74882]:   <model type="virtio"/>
Nov 21 14:20:54 user nova-compute[74882]:   <mtu size="1442"/>
Nov 21 14:20:54 user nova-compute[74882]:   <target dev="tap72906f62-8c"/>
Nov 21 14:20:54 user nova-compute[74882]: </interface>
Nov 21 14:20:54 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Start waiting for the detach event from libvirt for device tap72906f62-8c with device alias net1 for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-unplugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-unplugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:55 user nova-compute[74882]: WARNING nova.compute.manager [req-d0b9dffc-cb43-4ca8-8ebf-96bd305b0221 req-b6918511-ce97-4d65-84ff-6bf458df4d22 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received unexpected event network-vif-unplugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance with vm_state active and task_state None.
Nov 21 14:20:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:20:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:20:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:20:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:20:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:20:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:20:57 user nova-compute[74882]: WARNING nova.compute.manager [req-9b9876a9-3b87-45d5-9011-90e4e7fcbd69 req-eb6a81b0-3841-4660-92b9-fbff02ccd4f1 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received unexpected event network-vif-plugged-72906f62-8c9d-4af7-9a8d-06fa07fe7950 for instance with vm_state active and task_state None.
Nov 21 14:20:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:21:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:21:07 user nova-compute[74882]: INFO nova.compute.claims [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Claim successful on node user
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:21:08 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:21:08 user nova-compute[74882]: INFO nova.virt.block_device [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Booting with volume 55f6cd42-6971-4118-bd73-a6b5bd162c87 at /dev/vda
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.policy [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1448e4787c2c4c0bb6c3e1f7241246e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b45a2561f064eedb95133a91c79585e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG os_brick.utils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d51c2-cbfe-45ae-87b9-de945b34c437]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f5a8c8-fbbc-4c74-916e-a844ab5f8071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5372e26-3931-4235-a853-4d6474380b27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa19f02-26ce-4d79-9767-afd103dbe649]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:08 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:21:08 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226285a-d744-4694-9ca1-260963492d52]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG os_brick.utils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:08 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating existing volume attachment record: 39c36487-d618-4d0f-b5ff-f4931e893b13 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:21:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully created port: b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:21:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully created port: c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:21:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully created port: 19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:21:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully created port: cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully created port: a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:11 user nova-compute[74882]: INFO nova.compute.manager [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Terminating instance
Nov 21 14:21:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-vif-unplugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] No waiting events found dispatching network-vif-unplugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-f100c3f2-6dc4-4756-b7a3-afdbaa3d209a req-20595b39-00dd-453c-b34e-c6078bc7941d service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-vif-unplugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "51a5901c-6c03-4b4d-8737-8780e7224fcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.compute.manager [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Terminating instance
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully updated port: b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Instance destroyed successfully.
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.objects.instance [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lazy-loading 'resources' on Instance uuid 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1717958769',display_name='tempest-VolumesAssistedSnapshotsTest-server-1717958769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1717958769',id=8,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV8N4yxgVdRK01HFQutOwIthgXgkPWXkxVyqR+v6m5FqX2aGorRcylsw/cgdGD2IG97g8ccahhSe3hr9g6DETMsjzk7+mOHR15NMLkKTmEAGzpf8HO0/oLIlhzWj8oQMw==',key_name='tempest-keypair-973639123',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f462575fd893488d8e31ba67b58a1879',ramdisk_id='',reservation_id='r-bdzv4u47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-431845048',owner_user_name='tempest-VolumesAssistedSnapshotsTest-431845048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75ff0e0266134eb7abca050cf13030aa',uuid=6dfce4b7-6e4d-443a-96c1-ab0d11b553b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Converting VIF {"id": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "address": "fa:16:3e:8e:09:e6", "network": {"id": "cc215826-b43e-4bbe-b2c6-d31fce3e0337", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1399477068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f462575fd893488d8e31ba67b58a1879", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0ef15bf-19", "ovs_interfaceid": "a0ef15bf-19f8-4250-a6e0-989ee0bbccfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:09:e6,bridge_name='br-int',has_traffic_filtering=True,id=a0ef15bf-19f8-4250-a6e0-989ee0bbccfa,network=Network(cc215826-b43e-4bbe-b2c6-d31fce3e0337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ef15bf-19') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG os_vif [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:09:e6,bridge_name='br-int',has_traffic_filtering=True,id=a0ef15bf-19f8-4250-a6e0-989ee0bbccfa,network=Network(cc215826-b43e-4bbe-b2c6-d31fce3e0337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ef15bf-19') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0ef15bf-19, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f516be0e-4c9c-40bd-8a6b-eb657f1c1bf2) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: INFO os_vif [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:09:e6,bridge_name='br-int',has_traffic_filtering=True,id=a0ef15bf-19f8-4250-a6e0-989ee0bbccfa,network=Network(cc215826-b43e-4bbe-b2c6-d31fce3e0337),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0ef15bf-19')
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Deleting instance files /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2_del
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Deletion of /opt/stack/data/nova/instances/6dfce4b7-6e4d-443a-96c1-ab0d11b553b2_del complete
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.compute.manager [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5e0bbe00-65ee-4425-b375-6e5c6a6131e0 req-b8ff27a4-c492-4146-98a8-d9f9faa663f3 service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Instance destroyed successfully.
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.objects.instance [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lazy-loading 'resources' on Instance uuid 51a5901c-6c03-4b4d-8737-8780e7224fcf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1156448244',display_name='tempest-ServersNegativeTestJSON-server-1156448244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1156448244',id=11,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:19:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8612dc478d4a40babe74b1fbf45eac93',ramdisk_id='',reservation_id='r-sehx8bvo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1655313892',owner_user_name='tempest-ServersNegativeTestJSON-1655313892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:30Z,user_data=None,user_id='ec7d58eda515420f8b815338d2efd377',uuid=51a5901c-6c03-4b4d-8737-8780e7224fcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converting VIF {"id": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "address": "fa:16:3e:4a:2b:34", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c09ab5-95", "ovs_interfaceid": "77c09ab5-9563-4a3c-b841-2919c6b2db58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=77c09ab5-9563-4a3c-b841-2919c6b2db58,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c09ab5-95') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG os_vif [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=77c09ab5-9563-4a3c-b841-2919c6b2db58,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c09ab5-95') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77c09ab5-95, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fd42e66-cf01-4b23-bbd3-b8694b6f6141) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:12 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b33785fd-01ad-4d08-9b66-f664b7440b1a is timed out.
Nov 21 14:21:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Successfully detached device vdb from instance b33785fd-01ad-4d08-9b66-f664b7440b1a from the live domain config.
Nov 21 14:21:12 user nova-compute[74882]: INFO os_vif [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:2b:34,bridge_name='br-int',has_traffic_filtering=True,id=77c09ab5-9563-4a3c-b841-2919c6b2db58,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c09ab5-95')
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Deleting instance files /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf_del
Nov 21 14:21:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Deletion of /opt/stack/data/nova/instances/51a5901c-6c03-4b4d-8737-8780e7224fcf_del complete
Nov 21 14:21:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:21:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsxbGZkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'c2e050c2-4d60-4af8-ab76-22189c8983e3'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:12 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f085aed-fefa-4eb1-b324-cb8d1e2fba1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:21:13 user nova-compute[74882]: No targets found.
Nov 21 14:21:13 user nova-compute[74882]: iSNS:
Nov 21 14:21:13 user nova-compute[74882]: No targets found.
Nov 21 14:21:13 user nova-compute[74882]: STATIC:
Nov 21 14:21:13 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:21:13 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:13 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:13 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:21:13 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:13 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:13 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3
Nov 21 14:21:13 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:13 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:13 user nova-compute[74882]: FIRMWARE:
Nov 21 14:21:13 user nova-compute[74882]: No targets found.
Nov 21 14:21:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:21:13 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:21:13 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f133dac7-c3d6-4a9d-b4cf-2d9482e086c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: INFO nova.compute.manager [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc1779a-820e-4fbe-ab9e-2f58b7217b01]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:21:13 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:13 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 (non-flash)
Nov 21 14:21:13 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:13 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c508ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afee86c-b66c-4c1a-bb1a-0ef48eb19feb]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab44380f-0cac-4492-8d83-640f270f42d7]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af7aa3-5acb-483f-b2a9-f231376bd29a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec2724-a5bc-4032-9a55-651aaf85cf5e]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully updated port: 29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3532927c-8fb0-4137-a06b-0613c2d0c448]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d345e21c-43b5-4bf4-9b33-9a95595f916a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260]
Nov 21 14:21:13 user nova-compute[74882]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3, portal: 172.16.0.220,3260] successful.
Nov 21 14:21:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e050c2-4d60-4af8-ab76-22189c8983e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46fd729-5899-4ad2-8252-328e121089f0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] <== disconnect_volume: return (331ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully updated port: f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:13 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:13 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Took 1.29 seconds to deallocate network for instance.
Nov 21 14:21:13 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Took 0.87 seconds to deallocate network for instance.
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Acquiring lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] No waiting events found dispatching network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:14 user nova-compute[74882]: WARNING nova.compute.manager [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received unexpected event network-vif-plugged-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa for instance with vm_state active and task_state deleting.
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] [instance: 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2] Received event network-vif-deleted-a0ef15bf-19f8-4250-a6e0-989ee0bbccfa {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-066ef000-a75e-41e0-ab0b-09ead495c61f req-14452e1f-9a90-4569-9fe1-6acfcc6c86c1 service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received event network-vif-deleted-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.objects.instance [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lazy-loading 'flavor' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-131b96a0-407e-4c8c-a1ea-49733d4b92a5 tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.994s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received event network-vif-unplugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Acquiring lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] No waiting events found dispatching network-vif-unplugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:14 user nova-compute[74882]: WARNING nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received unexpected event network-vif-unplugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance with vm_state deleted and task_state None.
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received event network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Acquiring lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] No waiting events found dispatching network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:14 user nova-compute[74882]: WARNING nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: 51a5901c-6c03-4b4d-8737-8780e7224fcf] Received unexpected event network-vif-plugged-77c09ab5-9563-4a3c-b841-2919c6b2db58 for instance with vm_state deleted and task_state None.
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-29164a1e-6f52-4e02-8bf9-af322c771dab. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port 29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.388s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:14 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Deleted allocations for instance 6dfce4b7-6e4d-443a-96c1-ab0d11b553b2
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-18c1a4f5-9239-47c6-b6a5-d7ba1a24ff24 tempest-VolumesAssistedSnapshotsTest-431845048 tempest-VolumesAssistedSnapshotsTest-431845048-project-member] Lock "6dfce4b7-6e4d-443a-96c1-ab0d11b553b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully updated port: c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-f3d78a1a-34cd-4673-ac41-572a523c57c0. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.network.neutron [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Waiting for libvirt event about the detach of device tap72906f62-8c with device alias net1 from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 is timed out.
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d8:5e:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap72906f62-8c"/></interface> {{(pid=74882) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d8:5e:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap72906f62-8c"/></interface>not found in domain: <domain type='kvm' id='9'>
Nov 21 14:21:15 user nova-compute[74882]:   <name>instance-00000009</name>
Nov 21 14:21:15 user nova-compute[74882]:   <uuid>4deaafad-f14d-4525-acaf-1ff5986f3db0</uuid>
Nov 21 14:21:15 user nova-compute[74882]:   <metadata>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:21:15 user nova-compute[74882]:   <nova:package version="0.0.0"/>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:name>tempest-device-tagging-server-1480492247</nova:name>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:creationTime>2023-11-21 14:20:00</nova:creationTime>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:flavor name="m1.tiny">
Nov 21 14:21:15 user nova-compute[74882]:     <nova:memory>512</nova:memory>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:disk>1</nova:disk>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:swap>0</nova:swap>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:vcpus>1</nova:vcpus>
Nov 21 14:21:15 user nova-compute[74882]:   </nova:flavor>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:owner>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:user uuid="ed0c9acb0c4a42beb3c41ba4ab44c4a8">tempest-TaggedAttachmentsTest-607886265-project-member</nova:user>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:project uuid="1525a2b149ed40f9b3bbd98d1792a84c">tempest-TaggedAttachmentsTest-607886265</nova:project>
Nov 21 14:21:15 user nova-compute[74882]:   </nova:owner>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:ports>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:port uuid="eba59df5-fece-4e7b-923c-3fd0f0a8c6cd">
Nov 21 14:21:15 user nova-compute[74882]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:21:15 user nova-compute[74882]:     </nova:port>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:port uuid="72906f62-8c9d-4af7-9a8d-06fa07fe7950">
Nov 21 14:21:15 user nova-compute[74882]:       <nova:ip type="fixed" address="10.10.10.27" ipVersion="4"/>
Nov 21 14:21:15 user nova-compute[74882]:     </nova:port>
Nov 21 14:21:15 user nova-compute[74882]:   </nova:ports>
Nov 21 14:21:15 user nova-compute[74882]: </nova:instance>
Nov 21 14:21:15 user nova-compute[74882]:   </metadata>
Nov 21 14:21:15 user nova-compute[74882]:   <memory unit='KiB'>524288</memory>
Nov 21 14:21:15 user nova-compute[74882]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 21 14:21:15 user nova-compute[74882]:   <vcpu placement='static'>1</vcpu>
Nov 21 14:21:15 user nova-compute[74882]:   <resource>
Nov 21 14:21:15 user nova-compute[74882]:     <partition>/machine</partition>
Nov 21 14:21:15 user nova-compute[74882]:   </resource>
Nov 21 14:21:15 user nova-compute[74882]:   <sysinfo type='smbios'>
Nov 21 14:21:15 user nova-compute[74882]:     <system>
Nov 21 14:21:15 user nova-compute[74882]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 21 14:21:15 user nova-compute[74882]:       <entry name='product'>OpenStack Nova</entry>
Nov 21 14:21:15 user nova-compute[74882]:       <entry name='version'>0.0.0</entry>
Nov 21 14:21:15 user nova-compute[74882]:       <entry name='serial'>4deaafad-f14d-4525-acaf-1ff5986f3db0</entry>
Nov 21 14:21:15 user nova-compute[74882]:       <entry name='uuid'>4deaafad-f14d-4525-acaf-1ff5986f3db0</entry>
Nov 21 14:21:15 user nova-compute[74882]:       <entry name='family'>Virtual Machine</entry>
Nov 21 14:21:15 user nova-compute[74882]:     </system>
Nov 21 14:21:15 user nova-compute[74882]:   </sysinfo>
Nov 21 14:21:15 user nova-compute[74882]:   <os>
Nov 21 14:21:15 user nova-compute[74882]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 21 14:21:15 user nova-compute[74882]:     <boot dev='hd'/>
Nov 21 14:21:15 user nova-compute[74882]:     <smbios mode='sysinfo'/>
Nov 21 14:21:15 user nova-compute[74882]:   </os>
Nov 21 14:21:15 user nova-compute[74882]:   <features>
Nov 21 14:21:15 user nova-compute[74882]:     <acpi/>
Nov 21 14:21:15 user nova-compute[74882]:     <apic/>
Nov 21 14:21:15 user nova-compute[74882]:     <vmcoreinfo state='on'/>
Nov 21 14:21:15 user nova-compute[74882]:   </features>
Nov 21 14:21:15 user nova-compute[74882]:   <cpu mode='custom' match='exact' check='full'>
Nov 21 14:21:15 user nova-compute[74882]:     <model fallback='forbid'>Nehalem</model>
Nov 21 14:21:15 user nova-compute[74882]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 21 14:21:15 user nova-compute[74882]:     <feature policy='require' name='vme'/>
Nov 21 14:21:15 user nova-compute[74882]:     <feature policy='require' name='x2apic'/>
Nov 21 14:21:15 user nova-compute[74882]:     <feature policy='require' name='hypervisor'/>
Nov 21 14:21:15 user nova-compute[74882]:   </cpu>
Nov 21 14:21:15 user nova-compute[74882]:   <clock offset='utc'>
Nov 21 14:21:15 user nova-compute[74882]:     <timer name='pit' tickpolicy='delay'/>
Nov 21 14:21:15 user nova-compute[74882]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 21 14:21:15 user nova-compute[74882]:     <timer name='hpet' present='no'/>
Nov 21 14:21:15 user nova-compute[74882]:   </clock>
Nov 21 14:21:15 user nova-compute[74882]:   <on_poweroff>destroy</on_poweroff>
Nov 21 14:21:15 user nova-compute[74882]:   <on_reboot>restart</on_reboot>
Nov 21 14:21:15 user nova-compute[74882]:   <on_crash>destroy</on_crash>
Nov 21 14:21:15 user nova-compute[74882]:   <devices>
Nov 21 14:21:15 user nova-compute[74882]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 21 14:21:15 user nova-compute[74882]:     <disk type='file' device='disk'>
Nov 21 14:21:15 user nova-compute[74882]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 21 14:21:15 user nova-compute[74882]:       <source file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk' index='2'/>
Nov 21 14:21:15 user nova-compute[74882]:       <backingStore type='file' index='3'>
Nov 21 14:21:15 user nova-compute[74882]:         <format type='raw'/>
Nov 21 14:21:15 user nova-compute[74882]:         <source file='/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d'/>
Nov 21 14:21:15 user nova-compute[74882]:         <backingStore/>
Nov 21 14:21:15 user nova-compute[74882]:       </backingStore>
Nov 21 14:21:15 user nova-compute[74882]:       <target dev='vda' bus='virtio'/>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='virtio-disk0'/>
Nov 21 14:21:15 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </disk>
Nov 21 14:21:15 user nova-compute[74882]:     <disk type='file' device='cdrom'>
Nov 21 14:21:15 user nova-compute[74882]:       <driver name='qemu' type='raw' cache='none'/>
Nov 21 14:21:15 user nova-compute[74882]:       <source file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk.config' index='1'/>
Nov 21 14:21:15 user nova-compute[74882]:       <backingStore/>
Nov 21 14:21:15 user nova-compute[74882]:       <target dev='hda' bus='ide'/>
Nov 21 14:21:15 user nova-compute[74882]:       <readonly/>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='ide0-0-0'/>
Nov 21 14:21:15 user nova-compute[74882]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </disk>
Nov 21 14:21:15 user nova-compute[74882]:     <controller type='usb' index='0' model='none'>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='usb'/>
Nov 21 14:21:15 user nova-compute[74882]:     </controller>
Nov 21 14:21:15 user nova-compute[74882]:     <controller type='pci' index='0' model='pci-root'>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='pci.0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </controller>
Nov 21 14:21:15 user nova-compute[74882]:     <controller type='ide' index='0'>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='ide'/>
Nov 21 14:21:15 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 21 14:21:15 user nova-compute[74882]:     </controller>
Nov 21 14:21:15 user nova-compute[74882]:     <interface type='ethernet'>
Nov 21 14:21:15 user nova-compute[74882]:       <mac address='fa:16:3e:38:61:c9'/>
Nov 21 14:21:15 user nova-compute[74882]:       <target dev='tapeba59df5-fe'/>
Nov 21 14:21:15 user nova-compute[74882]:       <model type='virtio'/>
Nov 21 14:21:15 user nova-compute[74882]:       <mtu size='1442'/>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='net0'/>
Nov 21 14:21:15 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </interface>
Nov 21 14:21:15 user nova-compute[74882]:     <serial type='pty'>
Nov 21 14:21:15 user nova-compute[74882]:       <source path='/dev/pts/8'/>
Nov 21 14:21:15 user nova-compute[74882]:       <log file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/console.log' append='off'/>
Nov 21 14:21:15 user nova-compute[74882]:       <target type='isa-serial' port='0'>
Nov 21 14:21:15 user nova-compute[74882]:         <model name='isa-serial'/>
Nov 21 14:21:15 user nova-compute[74882]:       </target>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='serial0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </serial>
Nov 21 14:21:15 user nova-compute[74882]:     <console type='pty' tty='/dev/pts/8'>
Nov 21 14:21:15 user nova-compute[74882]:       <source path='/dev/pts/8'/>
Nov 21 14:21:15 user nova-compute[74882]:       <log file='/opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/console.log' append='off'/>
Nov 21 14:21:15 user nova-compute[74882]:       <target type='serial' port='0'/>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='serial0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </console>
Nov 21 14:21:15 user nova-compute[74882]:     <input type='mouse' bus='ps2'>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='input0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </input>
Nov 21 14:21:15 user nova-compute[74882]:     <input type='keyboard' bus='ps2'>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='input1'/>
Nov 21 14:21:15 user nova-compute[74882]:     </input>
Nov 21 14:21:15 user nova-compute[74882]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Nov 21 14:21:15 user nova-compute[74882]:       <listen type='address' address='0.0.0.0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </graphics>
Nov 21 14:21:15 user nova-compute[74882]:     <audio id='1' type='none'/>
Nov 21 14:21:15 user nova-compute[74882]:     <video>
Nov 21 14:21:15 user nova-compute[74882]:       <model type='virtio' heads='1' primary='yes'/>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='video0'/>
Nov 21 14:21:15 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </video>
Nov 21 14:21:15 user nova-compute[74882]:     <memballoon model='virtio'>
Nov 21 14:21:15 user nova-compute[74882]:       <stats period='10'/>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='balloon0'/>
Nov 21 14:21:15 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </memballoon>
Nov 21 14:21:15 user nova-compute[74882]:     <rng model='virtio'>
Nov 21 14:21:15 user nova-compute[74882]:       <backend model='random'>/dev/urandom</backend>
Nov 21 14:21:15 user nova-compute[74882]:       <alias name='rng0'/>
Nov 21 14:21:15 user nova-compute[74882]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 21 14:21:15 user nova-compute[74882]:     </rng>
Nov 21 14:21:15 user nova-compute[74882]:   </devices>
Nov 21 14:21:15 user nova-compute[74882]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 21 14:21:15 user nova-compute[74882]:     <label>libvirt-4deaafad-f14d-4525-acaf-1ff5986f3db0</label>
Nov 21 14:21:15 user nova-compute[74882]:     <imagelabel>libvirt-4deaafad-f14d-4525-acaf-1ff5986f3db0</imagelabel>
Nov 21 14:21:15 user nova-compute[74882]:   </seclabel>
Nov 21 14:21:15 user nova-compute[74882]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 21 14:21:15 user nova-compute[74882]:     <label>+64055:+108</label>
Nov 21 14:21:15 user nova-compute[74882]:     <imagelabel>+64055:+108</imagelabel>
Nov 21 14:21:15 user nova-compute[74882]:   </seclabel>
Nov 21 14:21:15 user nova-compute[74882]: </domain>
Nov 21 14:21:15 user nova-compute[74882]:  {{(pid=74882) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 21 14:21:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully detached device tap72906f62-8c from instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 from the live domain config.
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1480492247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1480492247',id=9,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA==',key_name='tempest-keypair-733819265',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1525a2b149ed40f9b3bbd98d1792a84c',ramdisk_id='',reservation_id='r-jjuy5qu8',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-607886265',owner_user_name='tempest-TaggedAttachmentsTest-607886265-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0c9acb0c4a42beb3c41ba4ab44c4a8',uuid=4deaafad-f14d-4525-acaf-1ff5986f3db0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converting VIF {"id": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "address": "fa:16:3e:d8:5e:7f", "network": {"id": "a602b959-4dfd-45a5-b7cc-ef03dfab5630", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1424185954", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72906f62-8c", "ovs_interfaceid": "72906f62-8c9d-4af7-9a8d-06fa07fe7950", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG os_vif [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72906f62-8c, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c07a8a8c-e693-465d-bac7-356fc5c7467e) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:15 user nova-compute[74882]: INFO os_vif [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:5e:7f,bridge_name='br-int',has_traffic_filtering=True,id=72906f62-8c9d-4af7-9a8d-06fa07fe7950,network=Network(a602b959-4dfd-45a5-b7cc-ef03dfab5630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72906f62-8c')
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:21:15 user nova-compute[74882]:   <nova:package version="0.0.0"/>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:name>tempest-device-tagging-server-1480492247</nova:name>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:creationTime>2023-11-21 14:21:15</nova:creationTime>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:flavor name="m1.tiny">
Nov 21 14:21:15 user nova-compute[74882]:     <nova:memory>512</nova:memory>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:disk>1</nova:disk>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:swap>0</nova:swap>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:vcpus>1</nova:vcpus>
Nov 21 14:21:15 user nova-compute[74882]:   </nova:flavor>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:owner>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:user uuid="ed0c9acb0c4a42beb3c41ba4ab44c4a8">tempest-TaggedAttachmentsTest-607886265-project-member</nova:user>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:project uuid="1525a2b149ed40f9b3bbd98d1792a84c">tempest-TaggedAttachmentsTest-607886265</nova:project>
Nov 21 14:21:15 user nova-compute[74882]:   </nova:owner>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:21:15 user nova-compute[74882]:   <nova:ports>
Nov 21 14:21:15 user nova-compute[74882]:     <nova:port uuid="eba59df5-fece-4e7b-923c-3fd0f0a8c6cd">
Nov 21 14:21:15 user nova-compute[74882]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:21:15 user nova-compute[74882]:     </nova:port>
Nov 21 14:21:15 user nova-compute[74882]:   </nova:ports>
Nov 21 14:21:15 user nova-compute[74882]: </nova:instance>
Nov 21 14:21:15 user nova-compute[74882]:  {{(pid=74882) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 21 14:21:15 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Deleted allocations for instance 51a5901c-6c03-4b4d-8737-8780e7224fcf
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-eac0ea7a-ad34-4b41-8048-c9bf5caf0fea tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "51a5901c-6c03-4b4d-8737-8780e7224fcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.919s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.network.neutron [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5f492d71-554b-46db-ae50-2f29b2d5141f req-7da0c764-f98d-4ec9-b06b-0d18a8d86001 service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:15 user nova-compute[74882]: INFO nova.virt.block_device [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Booting with volume e12c01ce-49fb-4570-88d1-9d57881b22e5 at /dev/vdb
Nov 21 14:21:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d64a81-0fa8-4dd2-b595-3cf5c0006a10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f0220-1513-4eec-bb21-204c61c0986c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cecb683-ca71-4ac6-8c4a-b71485856692]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0aecd-2245-40dd-bc7f-5d725a33bfdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:15 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[26020990-0e37-4e27-8a07-ec2b58da14b3]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating existing volume attachment record: ad50b6fc-ef04-422e-96f5-1fc0fc7d4d8f {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquired lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully updated port: 19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:15 user nova-compute[74882]: INFO nova.network.neutron [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Port 72906f62-8c9d-4af7-9a8d-06fa07fe7950 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 21 14:21:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating instance_info_cache with network_info: [{"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Releasing lock "refresh_cache-4deaafad-f14d-4525-acaf-1ff5986f3db0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb41b591-8bdc-43f3-8f27-100d6341ab20 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "interface-4deaafad-f14d-4525-acaf-1ff5986f3db0-72906f62-8c9d-4af7-9a8d-06fa07fe7950" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.374s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-c17f8fb0-313c-44e4-8d06-df35a52d365d. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully updated port: cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-380669a3-6e2e-4855-ba10-b74bfcf28644 req-8aa3ff4d-2c48-4dd1-81bc-facf870b5cf3 service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-deleted-72906f62-8c9d-4af7-9a8d-06fa07fe7950 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-19c29b2e-3376-4dd9-9ccb-233249c5bc67. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port 19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5094b733-b475-4a6a-8c80-423c47608f42 req-72f1a5fb-375c-4d38-8270-5ee6852c27b3 service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Successfully updated port: a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:21:17 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:21:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-cdccaae8-da2c-4767-b3da-21c792e1c4ce. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [{"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance network_info: |[{"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updated VIF entry in instance network info cache for port cdccaae8-da2c-4767-b3da-21c792e1c4ce. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [{"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-a7ca135d-1184-4166-b185-bb4acf34d4bc. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updated VIF entry in instance network info cache for port a7ca135d-1184-4166-b185-bb4acf34d4bc. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [{"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7779a1e0-bff0-4d2a-b892-1556afe1f741 req-b6c7e9c2-8f24-4cc5-8b70-58f16366271f service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:21 user nova-compute[74882]: INFO nova.virt.block_device [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Booting with volume e8c51fdd-7afa-44f1-8481-cd70f9fdc085 at /dev/vdc
Nov 21 14:21:21 user nova-compute[74882]: DEBUG os_brick.utils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c6e1a3-a7bd-4648-87a3-b0ca63771ad4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd52f0ce-ffe9-4102-9018-8854ba965a1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb42e15a-d593-4442-8c22-16a28541e1fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde9c954-4aeb-4081-8107-6b9d8e3a6d6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:21 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:21:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9918d0-f087-4bff-bfe4-169e1637ca07]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG os_brick.utils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:21 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating existing volume attachment record: d95043bb-d11d-4fce-9590-ae2d0058c088 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:21:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:21:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:26 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:26 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=25.476539611816406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance b33785fd-01ad-4d08-9b66-f664b7440b1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4deaafad-f14d-4525-acaf-1ff5986f3db0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 898bb3eb-39ce-4476-84b9-eb258eccbd12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1ae17530-7c7f-48bf-a225-11be40152845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:21:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:21:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Creating image(s)
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Ensure instance console log exists: /opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Start _get_guest_xml network_info=[{"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFnvCbyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95', 'attached_at': '', 'detached_at': '', 'volume_id': '55f6cd42-6971-4118-bd73-a6b5bd162c87', 'serial': '55f6cd42-6971-4118-bd73-a6b5bd162c87'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '39c36487-d618-4d0f-b5ff-f4931e893b13', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'notCmXrx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95', 'attached_at': '', 'detached_at': '', 'volume_id': 'e12c01ce-49fb-4570-88d1-9d57881b22e5', 'serial': 'e12c01ce-49fb-4570-88d1-9d57881b22e5'}, 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'attachment_id': 'ad50b6fc-ef04-422e-96f5-1fc0fc7d4d8f', 'disk_bus': 'virtio', 'volume_type': None}, {'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADULiSFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8c51fdd-7afa-44f1-8481-cd70f9fdc085', 'serial': 'e8c51fdd-7afa-44f1-8481-cd70f9fdc085'}, 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'attachment_id': 'd95043bb-d11d-4fce-9590-ae2d0058c088', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:21:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFnvCbyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:28 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:28 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:28 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aec7ac-8229-4b1a-8ddf-a37aaa61e685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:21:28 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:21:28 user nova-compute[74882]: INFO nova.compute.claims [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Claim successful on node user
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93def8d-0be5-4ea0-8c66-83cbcdb072d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87] added
Nov 21 14:21:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6012f53-bf27-445e-8da5-211e89638181]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a58ba-d071-42f5-a8b9-e2ac1e6f29de]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFnvCbyq {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFnvCbyq" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bff4e23-1f94-4cf4-9012-3d5053d871cf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GFnvCbyq'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[292168cd-852e-4bae-8a29-ed0b19d46dd4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e494d9b3-e2e9-439e-b519-c65adc7a4bd4]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:28 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:28 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c9cd25-cbcd-454a-85f6-cba175f957ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260]
Nov 21 14:21:28 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260] successful.
Nov 21 14:21:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4525f7-7bcb-46de-b03a-b6b9a066e15a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d924b291-7437-4c20-a63c-9f6d0dadf08f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:28 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:28 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:28 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:28 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[191cb153-b6ed-4a90-b103-2e123fd2ebfb]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:21:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.policy [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:21:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Creating image(s)
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk 1073741824" returned: 0 in 0.046s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Successfully created port: 767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFnvCbyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23135363263666135', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135363263666135', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'notCmXrx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:29 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:29 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:29 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[852c9fb6-72dc-4a15-806d-aa0023581eab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:21:29 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae236e1-e9cc-4d90-806d-4adc9261029a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5] added
Nov 21 14:21:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee28957-22e9-45b9-9d2b-8a4406a58a2e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0459c2-49c2-40cd-bc06-d4a99b5cfd59]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v notCmXrx {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v notCmXrx" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b47f20-eb39-459c-8610-06151da51767]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'notCmXrx'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Cannot resize image /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Ensure instance console log exists: /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3fb52d-c772-47d1-aae9-44149b8662aa]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9255e4-e3fc-4c36-85d8-2690714e8fc0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[565be080-2027-46d7-9e97-f508d77ebdf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260]
Nov 21 14:21:30 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260] successful.
Nov 21 14:21:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b76b04-77c4-4fff-b67a-3fcee34ee58d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d1dc1-1928-4a4d-ad7b-9a1496594e4d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:30 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.473s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f677dc8-0579-4aea-81e5-258c6cf20c1d]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'notCmXrx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Successfully updated port: 767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquired lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-changed-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Refreshing instance network info cache due to event network-changed-767f656d-f7c7-4ab0-8727-9c0142c27b7f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Acquiring lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updating instance_info_cache with network_info: [{"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Releasing lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance network_info: |[{"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Acquired lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.neutron [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Refreshing network info cache for port 767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Start _get_guest_xml network_info=[{"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:21:30 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:30 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099597183',display_name='tempest-tempest.common.compute-instance-1099597183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099597183',id=15,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8mqZtU9dDhvCuVjxEIBLJPFgcjfX35E31jVHYb6Lc3m9j+jmZLa1yJhH3D2tkKUs7tlnwkb7Cdqz73jwRTxTnN3X/sTnyM3XhOd57QBrQAk0BmSFwJXQhAsNS0DXgKGA==',key_name='tempest-keypair-1536111499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-2s0r5tw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=e29684d3-c5fd-4336-abc3-5da416e300e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'pci_devices' on Instance uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:21:30 user nova-compute[74882]:   <uuid>e29684d3-c5fd-4336-abc3-5da416e300e2</uuid>
Nov 21 14:21:30 user nova-compute[74882]:   <name>instance-0000000f</name>
Nov 21 14:21:30 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:21:30 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:21:30 user nova-compute[74882]:   <metadata>
Nov 21 14:21:30 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:21:30 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:21:30 user nova-compute[74882]:       <nova:name>tempest-tempest.common.compute-instance-1099597183</nova:name>
Nov 21 14:21:30 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:21:30</nova:creationTime>
Nov 21 14:21:30 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:21:30 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:21:30 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:21:30 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:21:30 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:21:30 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:21:30 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:21:30 user nova-compute[74882]:       <nova:owner>
Nov 21 14:21:30 user nova-compute[74882]:         <nova:user uuid="d9f06e22265f45beb3760ea3b9338c25">tempest-ServerActionsTestOtherA-538546207-project-member</nova:user>
Nov 21 14:21:30 user nova-compute[74882]:         <nova:project uuid="079d8162d1ea42ddbf31668c8a44cf73">tempest-ServerActionsTestOtherA-538546207</nova:project>
Nov 21 14:21:30 user nova-compute[74882]:       </nova:owner>
Nov 21 14:21:30 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:21:30 user nova-compute[74882]:       <nova:ports>
Nov 21 14:21:30 user nova-compute[74882]:         <nova:port uuid="767f656d-f7c7-4ab0-8727-9c0142c27b7f">
Nov 21 14:21:30 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 21 14:21:30 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:30 user nova-compute[74882]:       </nova:ports>
Nov 21 14:21:30 user nova-compute[74882]:     </nova:instance>
Nov 21 14:21:30 user nova-compute[74882]:   </metadata>
Nov 21 14:21:30 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:21:30 user nova-compute[74882]:     <system>
Nov 21 14:21:30 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:21:30 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:21:30 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:21:30 user nova-compute[74882]:       <entry name="serial">e29684d3-c5fd-4336-abc3-5da416e300e2</entry>
Nov 21 14:21:30 user nova-compute[74882]:       <entry name="uuid">e29684d3-c5fd-4336-abc3-5da416e300e2</entry>
Nov 21 14:21:30 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:21:30 user nova-compute[74882]:     </system>
Nov 21 14:21:30 user nova-compute[74882]:   </sysinfo>
Nov 21 14:21:30 user nova-compute[74882]:   <os>
Nov 21 14:21:30 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:21:30 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:21:30 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:21:30 user nova-compute[74882]:   </os>
Nov 21 14:21:30 user nova-compute[74882]:   <features>
Nov 21 14:21:30 user nova-compute[74882]:     <acpi/>
Nov 21 14:21:30 user nova-compute[74882]:     <apic/>
Nov 21 14:21:30 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:21:30 user nova-compute[74882]:   </features>
Nov 21 14:21:30 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:21:30 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:21:30 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:21:30 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:21:30 user nova-compute[74882]:   </clock>
Nov 21 14:21:30 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:21:30 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:21:30 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:21:30 user nova-compute[74882]:   </cpu>
Nov 21 14:21:30 user nova-compute[74882]:   <devices>
Nov 21 14:21:30 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:21:30 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:21:30 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk"/>
Nov 21 14:21:30 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:21:30 user nova-compute[74882]:     </disk>
Nov 21 14:21:30 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:30 user nova-compute[74882]:       <mac address="fa:16:3e:96:4e:f2"/>
Nov 21 14:21:30 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:30 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:30 user nova-compute[74882]:       <target dev="tap767f656d-f7"/>
Nov 21 14:21:30 user nova-compute[74882]:     </interface>
Nov 21 14:21:30 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:21:30 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/console.log" append="off"/>
Nov 21 14:21:30 user nova-compute[74882]:     </serial>
Nov 21 14:21:30 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:21:30 user nova-compute[74882]:     <video>
Nov 21 14:21:30 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:30 user nova-compute[74882]:     </video>
Nov 21 14:21:30 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:21:30 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:21:30 user nova-compute[74882]:     </rng>
Nov 21 14:21:30 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:21:30 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:21:30 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:21:30 user nova-compute[74882]:     </memballoon>
Nov 21 14:21:30 user nova-compute[74882]:   </devices>
Nov 21 14:21:30 user nova-compute[74882]: </domain>
Nov 21 14:21:30 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099597183',display_name='tempest-tempest.common.compute-instance-1099597183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099597183',id=15,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8mqZtU9dDhvCuVjxEIBLJPFgcjfX35E31jVHYb6Lc3m9j+jmZLa1yJhH3D2tkKUs7tlnwkb7Cdqz73jwRTxTnN3X/sTnyM3XhOd57QBrQAk0BmSFwJXQhAsNS0DXgKGA==',key_name='tempest-keypair-1536111499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-2s0r5tw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=e29684d3-c5fd-4336-abc3-5da416e300e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG os_vif [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cf6c291-ffe4-5789-87da-45f030373667', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap767f656d-f7, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap767f656d-f7, col_values=(('qos', UUID('4460422a-860a-443f-88cc-c632681d0e10')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap767f656d-f7, col_values=(('external_ids', {'iface-id': '767f656d-f7c7-4ab0-8727-9c0142c27b7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:4e:f2', 'vm-uuid': 'e29684d3-c5fd-4336-abc3-5da416e300e2'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:31 user nova-compute[74882]: INFO os_vif [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7')
Nov 21 14:21:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No VIF found with MAC fa:16:3e:96:4e:f2, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updated VIF entry in instance network info cache for port 767f656d-f7c7-4ab0-8727-9c0142c27b7f. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updating instance_info_cache with network_info: [{"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6af7b1a7-70d1-450c-8b35-f035e567ac5a req-5f0a5f84-22ca-44ac-9b79-ba2b4c9cbd73 service nova] Releasing lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '23364326530363839', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364326530363839', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADULiSFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:31 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:31 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:31 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465aff1-6d01-4fc4-bfae-61e7fdcc8e0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:21:31 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0b119-a96e-450d-b9ac-b8c9c0d9865f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085] added
Nov 21 14:21:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4017f1-5580-47b7-ae57-0ce20ffc2dfb]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[55794eef-1a3d-4529-b93e-144c84cd7894]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADULiSFX {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADULiSFX" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de8f50-c84a-4be0-8e2d-08d1769c0454]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADULiSFX'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[da81e614-1bfb-4d7f-b392-f310ca87bf2e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f5004-cae3-4f88-9ded-4d47451db94a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd5768-15bf-4fb2-b604-d7c91b229e4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260]
Nov 21 14:21:31 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260] successful.
Nov 21 14:21:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[964c1850-80d6-4346-b30e-d2857becf2df]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[df75f169-9f3c-4754-9cb2-80ec7a68f235]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:31 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a6a262-9b8a-4e69-b7fe-007e25bc103e]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:32 user nova-compute[74882]: WARNING nova.compute.manager [req-8cabe875-d318-4194-bc57-594d390a1cff req-85201477-02c7-4bdf-943a-f9e27e174a13 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received unexpected event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with vm_state building and task_state spawning.
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADULiSFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23561623465313665', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561623465313665', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:63:75,bridge_name='br-int',has_traffic_filtering=True,id=b14ee778-12aa-4208-bcdb-9fe2d8ea2a96,network=Network(f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ee778-12') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=29164a1e-6f52-4e02-8bf9-af322c771dab,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap29164a1e-6f') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:4e,bridge_name='br-int',has_traffic_filtering=True,id=f3d78a1a-34cd-4673-ac41-572a523c57c0,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3d78a1a-34') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:37:8c,bridge_name='br-int',has_traffic_filtering=True,id=c17f8fb0-313c-44e4-8d06-df35a52d365d,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f8fb0-31') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=19c29b2e-3376-4dd9-9ccb-233249c5bc67,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c29b2e-33') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=cdccaae8-da2c-4767-b3da-21c792e1c4ce,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdccaae8-da') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a7ca135d-1184-4166-b185-bb4acf34d4bc,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ca135d-11') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lazy-loading 'pci_devices' on Instance uuid d2fbf0ae-0e14-42aa-a25b-d349726bad95 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:21:32 user nova-compute[74882]:   <uuid>d2fbf0ae-0e14-42aa-a25b-d349726bad95</uuid>
Nov 21 14:21:32 user nova-compute[74882]:   <name>instance-0000000e</name>
Nov 21 14:21:32 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:21:32 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:21:32 user nova-compute[74882]:   <metadata>
Nov 21 14:21:32 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:21:32 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:21:32 user nova-compute[74882]:       <nova:name>tempest-device-tagging-server-1960452780</nova:name>
Nov 21 14:21:32 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:21:28</nova:creationTime>
Nov 21 14:21:32 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:21:32 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:21:32 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:21:32 user nova-compute[74882]:       <nova:owner>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:user uuid="1448e4787c2c4c0bb6c3e1f7241246e7">tempest-TaggedBootDevicesTest-1073959102-project-member</nova:user>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:project uuid="0b45a2561f064eedb95133a91c79585e">tempest-TaggedBootDevicesTest-1073959102</nova:project>
Nov 21 14:21:32 user nova-compute[74882]:       </nova:owner>
Nov 21 14:21:32 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:21:32 user nova-compute[74882]:       <nova:ports>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:port uuid="b14ee778-12aa-4208-bcdb-9fe2d8ea2a96">
Nov 21 14:21:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 14:21:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:port uuid="29164a1e-6f52-4e02-8bf9-af322c771dab">
Nov 21 14:21:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.14" ipVersion="4"/>
Nov 21 14:21:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:port uuid="f3d78a1a-34cd-4673-ac41-572a523c57c0">
Nov 21 14:21:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Nov 21 14:21:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:port uuid="c17f8fb0-313c-44e4-8d06-df35a52d365d">
Nov 21 14:21:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Nov 21 14:21:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:port uuid="19c29b2e-3376-4dd9-9ccb-233249c5bc67">
Nov 21 14:21:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.1.1.153" ipVersion="4"/>
Nov 21 14:21:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:port uuid="cdccaae8-da2c-4767-b3da-21c792e1c4ce">
Nov 21 14:21:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 21 14:21:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:32 user nova-compute[74882]:         <nova:port uuid="a7ca135d-1184-4166-b185-bb4acf34d4bc">
Nov 21 14:21:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 21 14:21:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:32 user nova-compute[74882]:       </nova:ports>
Nov 21 14:21:32 user nova-compute[74882]:     </nova:instance>
Nov 21 14:21:32 user nova-compute[74882]:   </metadata>
Nov 21 14:21:32 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:21:32 user nova-compute[74882]:     <system>
Nov 21 14:21:32 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:21:32 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:21:32 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:21:32 user nova-compute[74882]:       <entry name="serial">d2fbf0ae-0e14-42aa-a25b-d349726bad95</entry>
Nov 21 14:21:32 user nova-compute[74882]:       <entry name="uuid">d2fbf0ae-0e14-42aa-a25b-d349726bad95</entry>
Nov 21 14:21:32 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:21:32 user nova-compute[74882]:     </system>
Nov 21 14:21:32 user nova-compute[74882]:   </sysinfo>
Nov 21 14:21:32 user nova-compute[74882]:   <os>
Nov 21 14:21:32 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:21:32 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:21:32 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:21:32 user nova-compute[74882]:   </os>
Nov 21 14:21:32 user nova-compute[74882]:   <features>
Nov 21 14:21:32 user nova-compute[74882]:     <acpi/>
Nov 21 14:21:32 user nova-compute[74882]:     <apic/>
Nov 21 14:21:32 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:21:32 user nova-compute[74882]:   </features>
Nov 21 14:21:32 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:21:32 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:21:32 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:21:32 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:21:32 user nova-compute[74882]:   </clock>
Nov 21 14:21:32 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:21:32 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:21:32 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:21:32 user nova-compute[74882]:   </cpu>
Nov 21 14:21:32 user nova-compute[74882]:   <devices>
Nov 21 14:21:32 user nova-compute[74882]:     <disk type="file" device="cdrom">
Nov 21 14:21:32 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none"/>
Nov 21 14:21:32 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95/disk.config"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="hda" bus="ide"/>
Nov 21 14:21:32 user nova-compute[74882]:     </disk>
Nov 21 14:21:32 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:21:32 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:21:32 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <serial>55f6cd42-6971-4118-bd73-a6b5bd162c87</serial>
Nov 21 14:21:32 user nova-compute[74882]:     </disk>
Nov 21 14:21:32 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:21:32 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:21:32 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <serial>e12c01ce-49fb-4570-88d1-9d57881b22e5</serial>
Nov 21 14:21:32 user nova-compute[74882]:     </disk>
Nov 21 14:21:32 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:21:32 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:21:32 user nova-compute[74882]:       <source dev="/dev/sdd"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="vdc" bus="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <serial>e8c51fdd-7afa-44f1-8481-cd70f9fdc085</serial>
Nov 21 14:21:32 user nova-compute[74882]:     </disk>
Nov 21 14:21:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:32 user nova-compute[74882]:       <mac address="fa:16:3e:bd:63:75"/>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="tapb14ee778-12"/>
Nov 21 14:21:32 user nova-compute[74882]:     </interface>
Nov 21 14:21:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:32 user nova-compute[74882]:       <mac address="fa:16:3e:35:fe:e9"/>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="tap29164a1e-6f"/>
Nov 21 14:21:32 user nova-compute[74882]:     </interface>
Nov 21 14:21:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:32 user nova-compute[74882]:       <mac address="fa:16:3e:78:27:4e"/>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="tapf3d78a1a-34"/>
Nov 21 14:21:32 user nova-compute[74882]:     </interface>
Nov 21 14:21:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:32 user nova-compute[74882]:       <mac address="fa:16:3e:69:37:8c"/>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="tapc17f8fb0-31"/>
Nov 21 14:21:32 user nova-compute[74882]:     </interface>
Nov 21 14:21:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:32 user nova-compute[74882]:       <mac address="fa:16:3e:c1:22:8a"/>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="tap19c29b2e-33"/>
Nov 21 14:21:32 user nova-compute[74882]:     </interface>
Nov 21 14:21:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:32 user nova-compute[74882]:       <mac address="fa:16:3e:14:b1:b8"/>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="tapcdccaae8-da"/>
Nov 21 14:21:32 user nova-compute[74882]:     </interface>
Nov 21 14:21:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:32 user nova-compute[74882]:       <mac address="fa:16:3e:d9:8d:a7"/>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:32 user nova-compute[74882]:       <target dev="tapa7ca135d-11"/>
Nov 21 14:21:32 user nova-compute[74882]:     </interface>
Nov 21 14:21:32 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:21:32 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95/console.log" append="off"/>
Nov 21 14:21:32 user nova-compute[74882]:     </serial>
Nov 21 14:21:32 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:21:32 user nova-compute[74882]:     <video>
Nov 21 14:21:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:32 user nova-compute[74882]:     </video>
Nov 21 14:21:32 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:21:32 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:21:32 user nova-compute[74882]:     </rng>
Nov 21 14:21:32 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:21:32 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:21:32 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:21:32 user nova-compute[74882]:     </memballoon>
Nov 21 14:21:32 user nova-compute[74882]:   </devices>
Nov 21 14:21:32 user nova-compute[74882]: </domain>
Nov 21 14:21:32 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:63:75,bridge_name='br-int',has_traffic_filtering=True,id=b14ee778-12aa-4208-bcdb-9fe2d8ea2a96,network=Network(f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ee778-12') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:63:75,bridge_name='br-int',has_traffic_filtering=True,id=b14ee778-12aa-4208-bcdb-9fe2d8ea2a96,network=Network(f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ee778-12') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c2666f9-76ec-5949-a3a7-f483dd8ccdf7', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14ee778-12, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb14ee778-12, col_values=(('qos', UUID('fe0ff2a9-a4e4-4e98-bc35-f29030edb75a')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb14ee778-12, col_values=(('external_ids', {'iface-id': 'b14ee778-12aa-4208-bcdb-9fe2d8ea2a96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:63:75', 'vm-uuid': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: INFO os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:63:75,bridge_name='br-int',has_traffic_filtering=True,id=b14ee778-12aa-4208-bcdb-9fe2d8ea2a96,network=Network(f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ee778-12')
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=29164a1e-6f52-4e02-8bf9-af322c771dab,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap29164a1e-6f') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=29164a1e-6f52-4e02-8bf9-af322c771dab,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap29164a1e-6f') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf525125-ca81-5cc2-a90a-5be949773913', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29164a1e-6f, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29164a1e-6f, col_values=(('qos', UUID('a4125bb7-0037-44bb-908d-784e44a69af4')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29164a1e-6f, col_values=(('external_ids', {'iface-id': '29164a1e-6f52-4e02-8bf9-af322c771dab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:fe:e9', 'vm-uuid': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: INFO os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=29164a1e-6f52-4e02-8bf9-af322c771dab,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap29164a1e-6f')
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:4e,bridge_name='br-int',has_traffic_filtering=True,id=f3d78a1a-34cd-4673-ac41-572a523c57c0,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3d78a1a-34') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:4e,bridge_name='br-int',has_traffic_filtering=True,id=f3d78a1a-34cd-4673-ac41-572a523c57c0,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3d78a1a-34') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08f241f1-2f56-5df0-8e6e-74ba41a94eac', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3d78a1a-34, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3d78a1a-34, col_values=(('qos', UUID('e624b974-e94c-4a93-84b0-97405b8b5ad3')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3d78a1a-34, col_values=(('external_ids', {'iface-id': 'f3d78a1a-34cd-4673-ac41-572a523c57c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:27:4e', 'vm-uuid': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: INFO os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:4e,bridge_name='br-int',has_traffic_filtering=True,id=f3d78a1a-34cd-4673-ac41-572a523c57c0,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3d78a1a-34')
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:37:8c,bridge_name='br-int',has_traffic_filtering=True,id=c17f8fb0-313c-44e4-8d06-df35a52d365d,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f8fb0-31') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:37:8c,bridge_name='br-int',has_traffic_filtering=True,id=c17f8fb0-313c-44e4-8d06-df35a52d365d,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f8fb0-31') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2cdf01d-37eb-57cd-94e8-41018837fe37', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc17f8fb0-31, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc17f8fb0-31, col_values=(('qos', UUID('0c3ee9f2-7d38-4d1c-b686-7f265660d152')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc17f8fb0-31, col_values=(('external_ids', {'iface-id': 'c17f8fb0-313c-44e4-8d06-df35a52d365d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:37:8c', 'vm-uuid': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: INFO os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:37:8c,bridge_name='br-int',has_traffic_filtering=True,id=c17f8fb0-313c-44e4-8d06-df35a52d365d,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f8fb0-31')
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=19c29b2e-3376-4dd9-9ccb-233249c5bc67,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c29b2e-33') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=19c29b2e-3376-4dd9-9ccb-233249c5bc67,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c29b2e-33') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffa69bf7-1176-5c3a-aec6-cacdb6f09d33', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19c29b2e-33, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19c29b2e-33, col_values=(('qos', UUID('5ffd83b3-5a0f-4418-ba08-61a5455b3c6b')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19c29b2e-33, col_values=(('external_ids', {'iface-id': '19c29b2e-3376-4dd9-9ccb-233249c5bc67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:22:8a', 'vm-uuid': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: INFO os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=19c29b2e-3376-4dd9-9ccb-233249c5bc67,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c29b2e-33')
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=cdccaae8-da2c-4767-b3da-21c792e1c4ce,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdccaae8-da') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=cdccaae8-da2c-4767-b3da-21c792e1c4ce,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdccaae8-da') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3dd5088-b009-5db3-9bf9-4c62f35ab30a', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdccaae8-da, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdccaae8-da, col_values=(('qos', UUID('96695f0e-1044-4265-b8a4-da79deeb5b98')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdccaae8-da, col_values=(('external_ids', {'iface-id': 'cdccaae8-da2c-4767-b3da-21c792e1c4ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:b1:b8', 'vm-uuid': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: INFO os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=cdccaae8-da2c-4767-b3da-21c792e1c4ce,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdccaae8-da')
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a7ca135d-1184-4166-b185-bb4acf34d4bc,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ca135d-11') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a7ca135d-1184-4166-b185-bb4acf34d4bc,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ca135d-11') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6efcf494-8b87-5df4-b78c-c965fc8c910e', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7ca135d-11, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7ca135d-11, col_values=(('qos', UUID('9bd0eb24-ef92-44ef-bb97-b578607a0fc5')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7ca135d-11, col_values=(('external_ids', {'iface-id': 'a7ca135d-1184-4166-b185-bb4acf34d4bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:8d:a7', 'vm-uuid': 'd2fbf0ae-0e14-42aa-a25b-d349726bad95'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:33 user nova-compute[74882]: INFO os_vif [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a7ca135d-1184-4166-b185-bb4acf34d4bc,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ca135d-11')
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] No BDM found with device name hda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] No VIF found with MAC fa:16:3e:bd:63:75, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] No VIF found with MAC fa:16:3e:c1:22:8a, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:21:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Using config drive
Nov 21 14:21:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Creating config drive at /opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95/disk.config
Nov 21 14:21:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcshueavy {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcshueavy" returned: 0 in 0.051s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:21:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance spawned successfully.
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:34 user nova-compute[74882]: WARNING nova.compute.manager [req-7df4970b-5a37-48d5-a3e6-93205e6468e0 req-9852163b-1a3e-47a3-a4ad-da09496d2bde service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received unexpected event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with vm_state building and task_state spawning.
Nov 21 14:21:34 user nova-compute[74882]: INFO nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 21 14:21:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:21:34 user nova-compute[74882]: INFO nova.compute.manager [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Took 6.40 seconds to build instance.
Nov 21 14:21:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a815cece-c2d2-48cc-a0b5-52a50067fd73 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.515s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:36 user nova-compute[74882]: WARNING nova.compute.manager [req-04eb2dc5-a3d3-4728-9709-c9af817c7480 req-fdcd4b42-29cd-4d39-993d-1c03730a97c0 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab for instance with vm_state building and task_state spawning.
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:36 user nova-compute[74882]: WARNING nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance with vm_state building and task_state spawning.
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:36 user nova-compute[74882]: WARNING nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance with vm_state building and task_state spawning.
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:36 user nova-compute[74882]: WARNING nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance with vm_state building and task_state spawning.
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:36 user nova-compute[74882]: WARNING nova.compute.manager [req-40cb14c8-8042-476a-97ba-cfcf6694667c req-0b9a9807-7b0f-47b2-befe-dfc7a5416004 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance with vm_state building and task_state spawning.
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:37 user nova-compute[74882]: WARNING nova.compute.manager [req-95281c51-76d3-40cd-8f64-c61f43de7a3d req-cdc8e94a-cf8c-43bc-871a-fd866e1a8d59 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance with vm_state building and task_state spawning.
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquired lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'info_cache' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG nova.objects.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:38 user nova-compute[74882]: WARNING nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab for instance with vm_state building and task_state spawning.
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:38 user nova-compute[74882]: WARNING nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d for instance with vm_state building and task_state spawning.
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:38 user nova-compute[74882]: WARNING nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d for instance with vm_state building and task_state spawning.
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:38 user nova-compute[74882]: WARNING nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance with vm_state building and task_state spawning.
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:38 user nova-compute[74882]: WARNING nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance with vm_state building and task_state spawning.
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:38 user nova-compute[74882]: WARNING nova.compute.manager [req-0d3b414d-b8b0-41bb-b893-8d78a8b84e99 req-d6252178-6844-49c6-a258-4a306a93f62e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc for instance with vm_state building and task_state spawning.
Nov 21 14:21:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Releasing lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:38 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance destroyed successfully.
Nov 21 14:21:38 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'resources' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_vif [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf39421d4-14, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=568bb40d-4219-4daf-a2ec-7c3933e76d9e) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: INFO os_vif [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14')
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsMVroPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:39 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:39 user nova-compute[74882]: WARNING nova.compute.manager [req-3396122b-2a1f-4296-b8a8-38f32bc3b40a req-c97c7e14-ce08-4312-a91a-d76c4bd265ec service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance with vm_state building and task_state spawning.
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6f833f-dc08-47ac-b12c-5bdbf317f63d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:21:39 user nova-compute[74882]: No targets found.
Nov 21 14:21:39 user nova-compute[74882]: iSNS:
Nov 21 14:21:39 user nova-compute[74882]: No targets found.
Nov 21 14:21:39 user nova-compute[74882]: STATIC:
Nov 21 14:21:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:21:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:21:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5
Nov 21 14:21:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085
Nov 21 14:21:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:39 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87
Nov 21 14:21:39 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:21:39 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:21:39 user nova-compute[74882]: FIRMWARE:
Nov 21 14:21:39 user nova-compute[74882]: No targets found.
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:21:39 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:21:39 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[239a0548-c3e9-45ff-8784-0d6eb729deba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9dc748-de39-4d58-b6a4-560c486ea300]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c38bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f358b581-1bde-44de-addb-0b7e24d8e372]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1595a0-3666-471e-868e-ee688da3337b]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb24246-2891-406e-a7ae-e6a241488dde]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6439a76-1a83-43a0-ae42-291eaf348f8c]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e14e45e-e930-44af-a46f-4007e7a3c8f5]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c8ef0-bf12-4df9-b78e-00cbbdd0db08]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]
Nov 21 14:21:39 user nova-compute[74882]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7be35a-2293-4acb-bc72-5311cddc0a12]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== disconnect_volume: return (390ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Start _get_guest_xml network_info=[{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsMVroPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7892830a-13fc-48a2-bfd3-29a96b2a9113', 'attached_at': '', 'detached_at': '', 'volume_id': '949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'serial': '949666e2-574c-4f9a-bad7-2074e7b4d4b4'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': '6f3c5ea0-53b9-4ac3-b5ff-7dfc51d5634e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'numa_topology' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:21:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsMVroPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:39 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:39 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:39 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96f93d0-2b65-4270-878b-833a98434f42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:21:39 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8b360-1d51-469d-a316-824a108bac1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4] added
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[51547fc1-3e29-4e9a-8de5-0ee4405c3124]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a6a95c-ffdf-402c-a26b-262aac0693b7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsMVroPO {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SsMVroPO" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6847a0-2dd6-4d9d-9be9-1c40472a2308]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SsMVroPO'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[365b70c1-ebd4-4579-a432-e86eeb3726c4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d0862-73c1-4c96-91b0-196d8ee98660]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5997ad-a760-4cbe-87ac-326b717f4494]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]
Nov 21 14:21:39 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4562a4-49b5-41f8-a81b-99224f67905b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19791c3-0f6e-4d92-811c-792a66c7dd78]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:39 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:21:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a855c-72ec-41ee-a96e-7514e169bfb4]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsMVroPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:21:40 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance spawned successfully.
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:21:40 user nova-compute[74882]: INFO nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Took 11.79 seconds to spawn the instance on the hypervisor.
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:40 user nova-compute[74882]: WARNING nova.compute.manager [req-f93c119e-f8d2-47c8-82cb-5c04d616aafb req-6563d9b3-c72a-46f8-a99f-0818f9a47752 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc for instance with vm_state building and task_state spawning.
Nov 21 14:21:40 user nova-compute[74882]: INFO nova.compute.manager [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Took 32.65 seconds to build instance.
Nov 21 14:21:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33c2f6dc-dfbc-4821-a780-c3e7b61c2582 tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.742s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26330666430613530', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330666430613530', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'pci_devices' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.objects.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:21:41 user nova-compute[74882]:   <uuid>7892830a-13fc-48a2-bfd3-29a96b2a9113</uuid>
Nov 21 14:21:41 user nova-compute[74882]:   <name>instance-00000005</name>
Nov 21 14:21:41 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:21:41 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:21:41 user nova-compute[74882]:   <metadata>
Nov 21 14:21:41 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:21:41 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:21:41 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeTestJSON-server-70492316</nova:name>
Nov 21 14:21:41 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:21:39</nova:creationTime>
Nov 21 14:21:41 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:21:41 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:21:41 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:21:41 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:21:41 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:21:41 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:21:41 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:21:41 user nova-compute[74882]:       <nova:owner>
Nov 21 14:21:41 user nova-compute[74882]:         <nova:user uuid="c0cb90d4bdf74f9390124833ea8331bd">tempest-AttachVolumeTestJSON-1610644153-project-member</nova:user>
Nov 21 14:21:41 user nova-compute[74882]:         <nova:project uuid="894802e2e3d044199467be931dd8e036">tempest-AttachVolumeTestJSON-1610644153</nova:project>
Nov 21 14:21:41 user nova-compute[74882]:       </nova:owner>
Nov 21 14:21:41 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:21:41 user nova-compute[74882]:       <nova:ports>
Nov 21 14:21:41 user nova-compute[74882]:         <nova:port uuid="f39421d4-14c9-470b-9aab-7c4b25deccd2">
Nov 21 14:21:41 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 21 14:21:41 user nova-compute[74882]:         </nova:port>
Nov 21 14:21:41 user nova-compute[74882]:       </nova:ports>
Nov 21 14:21:41 user nova-compute[74882]:     </nova:instance>
Nov 21 14:21:41 user nova-compute[74882]:   </metadata>
Nov 21 14:21:41 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:21:41 user nova-compute[74882]:     <system>
Nov 21 14:21:41 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:21:41 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:21:41 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:21:41 user nova-compute[74882]:       <entry name="serial">7892830a-13fc-48a2-bfd3-29a96b2a9113</entry>
Nov 21 14:21:41 user nova-compute[74882]:       <entry name="uuid">7892830a-13fc-48a2-bfd3-29a96b2a9113</entry>
Nov 21 14:21:41 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:21:41 user nova-compute[74882]:     </system>
Nov 21 14:21:41 user nova-compute[74882]:   </sysinfo>
Nov 21 14:21:41 user nova-compute[74882]:   <os>
Nov 21 14:21:41 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:21:41 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:21:41 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:21:41 user nova-compute[74882]:   </os>
Nov 21 14:21:41 user nova-compute[74882]:   <features>
Nov 21 14:21:41 user nova-compute[74882]:     <acpi/>
Nov 21 14:21:41 user nova-compute[74882]:     <apic/>
Nov 21 14:21:41 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:21:41 user nova-compute[74882]:   </features>
Nov 21 14:21:41 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:21:41 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:21:41 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:21:41 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:21:41 user nova-compute[74882]:   </clock>
Nov 21 14:21:41 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:21:41 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:21:41 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:21:41 user nova-compute[74882]:   </cpu>
Nov 21 14:21:41 user nova-compute[74882]:   <devices>
Nov 21 14:21:41 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:21:41 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:21:41 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk"/>
Nov 21 14:21:41 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:21:41 user nova-compute[74882]:     </disk>
Nov 21 14:21:41 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:21:41 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:21:41 user nova-compute[74882]:       <source dev="/dev/sde"/>
Nov 21 14:21:41 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:21:41 user nova-compute[74882]:       <serial>949666e2-574c-4f9a-bad7-2074e7b4d4b4</serial>
Nov 21 14:21:41 user nova-compute[74882]:     </disk>
Nov 21 14:21:41 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:21:41 user nova-compute[74882]:       <mac address="fa:16:3e:5c:a6:7f"/>
Nov 21 14:21:41 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:41 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:21:41 user nova-compute[74882]:       <target dev="tapf39421d4-14"/>
Nov 21 14:21:41 user nova-compute[74882]:     </interface>
Nov 21 14:21:41 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:21:41 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/console.log" append="off"/>
Nov 21 14:21:41 user nova-compute[74882]:     </serial>
Nov 21 14:21:41 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:21:41 user nova-compute[74882]:     <video>
Nov 21 14:21:41 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:21:41 user nova-compute[74882]:     </video>
Nov 21 14:21:41 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:21:41 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:21:41 user nova-compute[74882]:     </rng>
Nov 21 14:21:41 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:21:41 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:21:41 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:21:41 user nova-compute[74882]:     </memballoon>
Nov 21 14:21:41 user nova-compute[74882]:   </devices>
Nov 21 14:21:41 user nova-compute[74882]: </domain>
Nov 21 14:21:41 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.objects.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Cannot resize image /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'migration_context' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.objects.base [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG os_vif [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19d5e82a-b4b2-51a0-a994-4278e9a69e26', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf39421d4-14, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf39421d4-14, col_values=(('qos', UUID('e66c97d6-b4be-46c9-a678-327a04f93dd0')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf39421d4-14, col_values=(('external_ids', {'iface-id': 'f39421d4-14c9-470b-9aab-7c4b25deccd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:a6:7f', 'vm-uuid': '7892830a-13fc-48a2-bfd3-29a96b2a9113'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:42 user nova-compute[74882]: INFO os_vif [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14')
Nov 21 14:21:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:42 user nova-compute[74882]: INFO nova.compute.manager [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Terminating instance
Nov 21 14:21:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-vif-unplugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] No waiting events found dispatching network-vif-unplugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-c28ab143-3fb8-4b70-8804-0f3ba810cbb6 req-19061a9b-20c8-4cd0-a766-a75869d91323 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-vif-unplugged-090c076d-0081-4d00-9cb0-a8e9967622ad for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-changed-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Refreshing instance network info cache due to event network-changed-9b592c77-100d-4bcd-8922-ca8fadfb012a. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Acquiring lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Acquired lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.network.neutron [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Refreshing network info cache for port 9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-changed-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Refreshing instance network info cache due to event network-changed-50684016-dcd4-4d67-86ea-28f525147f47. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Acquiring lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Acquired lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:21:43 user nova-compute[74882]: DEBUG nova.network.neutron [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Refreshing network info cache for port 50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Updated VIF entry in instance network info cache for port 9b592c77-100d-4bcd-8922-ca8fadfb012a. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Updating instance_info_cache with network_info: [{"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "898bb3eb-39ce-4476-84b9-eb258eccbd12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:44 user nova-compute[74882]: INFO nova.compute.manager [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Terminating instance
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-634f995e-3b97-4aa8-9e6a-5ca8a6eb2afe req-df3aff7f-2566-4df1-942d-43dae99024a3 service nova] Releasing lock "refresh_cache-898bb3eb-39ce-4476-84b9-eb258eccbd12" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Instance destroyed successfully.
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.objects.instance [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lazy-loading 'resources' on Instance uuid b33785fd-01ad-4d08-9b66-f664b7440b1a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-913422417',display_name='tempest-TestVolumeSwap-server-913422417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-913422417',id=6,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDJcP9bpfqyVfwqPqOZyspaUE/J2iSeVHMJqrkSft/En7JrwcVC3zqiSI5oD9SXW88j/ds3f/l+tqb3Zp3UNXzjHvRgqaH1GU8gFw+zAqyYFNe7nwZO6YW1S7+oCrcVpw==',key_name='tempest-keypair-1966473581',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b7c11f81daa43449a6e96e3a20aa06e',ramdisk_id='',reservation_id='r-mlrrhrlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1148565282',owner_user_name='tempest-TestVolumeSwap-1148565282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9144e297f5b43a181844d967adcebae',uuid=b33785fd-01ad-4d08-9b66-f664b7440b1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Converting VIF {"id": "090c076d-0081-4d00-9cb0-a8e9967622ad", "address": "fa:16:3e:59:5d:47", "network": {"id": "ba264b79-eb59-49d9-b15a-8a7aea9d0d57", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1685008054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b7c11f81daa43449a6e96e3a20aa06e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap090c076d-00", "ovs_interfaceid": "090c076d-0081-4d00-9cb0-a8e9967622ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:5d:47,bridge_name='br-int',has_traffic_filtering=True,id=090c076d-0081-4d00-9cb0-a8e9967622ad,network=Network(ba264b79-eb59-49d9-b15a-8a7aea9d0d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c076d-00') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG os_vif [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:5d:47,bridge_name='br-int',has_traffic_filtering=True,id=090c076d-0081-4d00-9cb0-a8e9967622ad,network=Network(ba264b79-eb59-49d9-b15a-8a7aea9d0d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c076d-00') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap090c076d-00, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e96f187c-d13c-48ca-ae26-b6552139b10a) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:44 user nova-compute[74882]: INFO os_vif [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:5d:47,bridge_name='br-int',has_traffic_filtering=True,id=090c076d-0081-4d00-9cb0-a8e9967622ad,network=Network(ba264b79-eb59-49d9-b15a-8a7aea9d0d57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap090c076d-00')
Nov 21 14:21:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Deleting instance files /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a_del
Nov 21 14:21:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Deletion of /opt/stack/data/nova/instances/b33785fd-01ad-4d08-9b66-f664b7440b1a_del complete
Nov 21 14:21:44 user nova-compute[74882]: INFO nova.compute.manager [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 21 14:21:44 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updated VIF entry in instance network info cache for port 50684016-dcd4-4d67-86ea-28f525147f47. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:21:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updating instance_info_cache with network_info: [{"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8e8c9045-afc0-440c-bc33-ff937e297b6c req-5bcdba6e-32b5-4e74-a737-cdcd4a66a004 service nova] Releasing lock "refresh_cache-1ae17530-7c7f-48bf-a225-11be40152845" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Instance destroyed successfully.
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'resources' on Instance uuid 898bb3eb-39ce-4476-84b9-eb258eccbd12 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-321117593',display_name='tempest-AttachVolumeNegativeTest-server-321117593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-321117593',id=12,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmIiYZduC/8zjcxqC2bk1JleTD0+t/hkaazJI/k/Il/NHseBS83IvC42+J66mS/tO1amTRIYRJ04sNxY0CDyvrg3n10xHf4aXD9ylxnpteEJBrIC5hr41U2WjErWm0YhA==',key_name='tempest-keypair-1382497572',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:20:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-s7i1lq19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=898bb3eb-39ce-4476-84b9-eb258eccbd12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "address": "fa:16:3e:03:49:10", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b592c77-10", "ovs_interfaceid": "9b592c77-100d-4bcd-8922-ca8fadfb012a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:10,bridge_name='br-int',has_traffic_filtering=True,id=9b592c77-100d-4bcd-8922-ca8fadfb012a,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b592c77-10') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG os_vif [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:10,bridge_name='br-int',has_traffic_filtering=True,id=9b592c77-100d-4bcd-8922-ca8fadfb012a,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b592c77-10') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b592c77-10, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3485e56b-ccd3-403f-9670-48c648f2e21a) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: INFO os_vif [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:49:10,bridge_name='br-int',has_traffic_filtering=True,id=9b592c77-100d-4bcd-8922-ca8fadfb012a,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b592c77-10')
Nov 21 14:21:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Deleting instance files /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12_del
Nov 21 14:21:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Deletion of /opt/stack/data/nova/instances/898bb3eb-39ce-4476-84b9-eb258eccbd12_del complete
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'flavor' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Acquiring lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] No waiting events found dispatching network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:45 user nova-compute[74882]: WARNING nova.compute.manager [req-149454de-0da2-415e-b2f8-55bc818ced1c req-0daae4e0-338c-4bc1-97ad-a3df02034846 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received unexpected event network-vif-plugged-090c076d-0081-4d00-9cb0-a8e9967622ad for instance with vm_state active and task_state deleting.
Nov 21 14:21:45 user nova-compute[74882]: INFO nova.compute.manager [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-vif-unplugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Acquiring lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] No waiting events found dispatching network-vif-unplugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-ddc09ec0-461c-4139-9d08-fb2129f6956b req-e92898e4-4bd7-4802-aeec-585e904c3b41 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-vif-unplugged-9b592c77-100d-4bcd-8922-ca8fadfb012a for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:45 user nova-compute[74882]: INFO nova.compute.manager [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Attaching volume 0ba22751-58d1-456d-be4d-ddcb85ff1a4f to /dev/vdb
Nov 21 14:21:45 user nova-compute[74882]: DEBUG os_brick.utils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cca24e3-9867-41c0-b1e7-b865c60e6a73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[793fffb3-5e0c-4c80-a76d-8e0f4f3ca035]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ea475f-0bfe-4ca2-82a0-1f6ffead99cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf10e16-aba5-45b5-a884-6ecd1e605f2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:21:46 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e6717-a7c9-4507-9b25-7cb54d408fc8]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG os_brick.utils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updating existing volume attachment record: d5292564-b123-43fe-b5c0-de3df82cf6d9 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:46 user nova-compute[74882]: INFO nova.compute.manager [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Terminating instance
Nov 21 14:21:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:46 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Took 1.79 seconds to deallocate network for instance.
Nov 21 14:21:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Instance destroyed successfully.
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lazy-loading 'resources' on Instance uuid 4deaafad-f14d-4525-acaf-1ff5986f3db0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1480492247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1480492247',id=9,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfsYUuDxi0KUD0WjNYaF4x1A4JRlByT9wm8T4bxLG29cKXcVVnU1oUDiCkNRZB8c8308K4TSPFo2kTCJFnOcAISd7W1bAnWfUHL31EUA4Jr24UJ4Wv8IeZROQIWL52icA==',key_name='tempest-keypair-733819265',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1525a2b149ed40f9b3bbd98d1792a84c',ramdisk_id='',reservation_id='r-jjuy5qu8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-607886265',owner_user_name='tempest-TaggedAttachmentsTest-607886265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed0c9acb0c4a42beb3c41ba4ab44c4a8',uuid=4deaafad-f14d-4525-acaf-1ff5986f3db0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converting VIF {"id": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "address": "fa:16:3e:38:61:c9", "network": {"id": "e15ffa5f-4555-47e7-9a6b-827621cc2a3c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-854781588-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1525a2b149ed40f9b3bbd98d1792a84c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeba59df5-fe", "ovs_interfaceid": "eba59df5-fece-4e7b-923c-3fd0f0a8c6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:61:c9,bridge_name='br-int',has_traffic_filtering=True,id=eba59df5-fece-4e7b-923c-3fd0f0a8c6cd,network=Network(e15ffa5f-4555-47e7-9a6b-827621cc2a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba59df5-fe') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG os_vif [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:61:c9,bridge_name='br-int',has_traffic_filtering=True,id=eba59df5-fece-4e7b-923c-3fd0f0a8c6cd,network=Network(e15ffa5f-4555-47e7-9a6b-827621cc2a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba59df5-fe') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeba59df5-fe, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4d48961-d09e-453b-844e-ddc54d04098a) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:47 user nova-compute[74882]: INFO os_vif [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:61:c9,bridge_name='br-int',has_traffic_filtering=True,id=eba59df5-fece-4e7b-923c-3fd0f0a8c6cd,network=Network(e15ffa5f-4555-47e7-9a6b-827621cc2a3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeba59df5-fe')
Nov 21 14:21:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Deleting instance files /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0_del
Nov 21 14:21:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Deletion of /opt/stack/data/nova/instances/4deaafad-f14d-4525-acaf-1ff5986f3db0_del complete
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:47 user nova-compute[74882]: INFO nova.compute.manager [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:21:47 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Deleted allocations for instance b33785fd-01ad-4d08-9b66-f664b7440b1a
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9eb079bc-13f7-48b0-ae66-926fe95dbf4e tempest-TestVolumeSwap-1148565282 tempest-TestVolumeSwap-1148565282-project-member] Lock "b33785fd-01ad-4d08-9b66-f664b7440b1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.404s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-unplugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-unplugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-8c164ae8-1038-4c30-9c27-dfd30543f290 req-667593d0-a9aa-433d-ae71-668b2528ea6f service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-unplugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Acquiring lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] No waiting events found dispatching network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:47 user nova-compute[74882]: WARNING nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received unexpected event network-vif-plugged-9b592c77-100d-4bcd-8922-ca8fadfb012a for instance with vm_state active and task_state deleting.
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:47 user nova-compute[74882]: WARNING nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state stopped and task_state powering-on.
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: b33785fd-01ad-4d08-9b66-f664b7440b1a] Received event network-vif-deleted-090c076d-0081-4d00-9cb0-a8e9967622ad {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:47 user nova-compute[74882]: WARNING nova.compute.manager [req-7f190256-7796-469a-a9a1-d7fc844d8519 req-6f2865b5-aad7-4e3c-b3ba-cde0b42dcba3 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state stopped and task_state powering-on.
Nov 21 14:21:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance rebooted successfully.
Nov 21 14:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b2cef133-21e5-49bb-9ba2-15f07683db34 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:48 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Took 1.04 seconds to deallocate network for instance.
Nov 21 14:21:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:21:48 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Took 2.97 seconds to deallocate network for instance.
Nov 21 14:21:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.201s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:48 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Deleted allocations for instance 4deaafad-f14d-4525-acaf-1ff5986f3db0
Nov 21 14:21:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35ecdd28-a798-4a2d-a20e-13c05807f342 tempest-TaggedAttachmentsTest-607886265 tempest-TaggedAttachmentsTest-607886265-project-member] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:49 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Deleted allocations for instance 898bb3eb-39ce-4476-84b9-eb258eccbd12
Nov 21 14:21:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e242743b-c6ab-480e-8a52-240be4c04f9a tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "898bb3eb-39ce-4476-84b9-eb258eccbd12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.057s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] [instance: 898bb3eb-39ce-4476-84b9-eb258eccbd12] Received event network-vif-deleted-9b592c77-100d-4bcd-8922-ca8fadfb012a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Acquiring lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] Lock "4deaafad-f14d-4525-acaf-1ff5986f3db0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] No waiting events found dispatching network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:21:49 user nova-compute[74882]: WARNING nova.compute.manager [req-8ca2338e-82f5-4b10-b432-206e802b85d9 req-fbbf66ba-fb3d-42bf-b55b-b0a83f55211a service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received unexpected event network-vif-plugged-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd for instance with vm_state deleted and task_state None.
Nov 21 14:21:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-b0a9df24-66dd-4aa7-b3d4-6227d5ffad19 req-01abd523-c1d7-4f50-9074-3e7cb686e4ae service nova] [instance: 4deaafad-f14d-4525-acaf-1ff5986f3db0] Received event network-vif-deleted-eba59df5-fece-4e7b-923c-3fd0f0a8c6cd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:21:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:21:53 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GboLInMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:21:53 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:53 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:53 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:53 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:21:53 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:21:53 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:21:53 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de57b3-5827-445d-bbaa-dea29268147d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:21:54 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c2653e-572f-4271-9e87-a17dd3e2a26b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f] added
Nov 21 14:21:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb340092-5617-4fff-9850-60162384f1c8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8547b4-db67-431c-abfe-fecaa35df46f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GboLInMk {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GboLInMk" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1921cb83-4df1-4a37-8a79-bfaa43cfda70]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GboLInMk'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a98af-dc91-46b8-a30e-c48a804e557d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[090ab610-7f03-4f16-9a96-916b5ae0bb2e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[374189db-ac0f-40f4-a9d3-d31d275327fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260]
Nov 21 14:21:54 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260] successful.
Nov 21 14:21:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e7f91f-ec43-4fc2-896f-6210869faed0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eadc77-2a6f-4ba3-8c7b-e9ac1b9b1afc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:21:54 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:21:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[13da927f-6ae8-4d92-8a6b-881e20d4a66f]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:21:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GboLInMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23135653334363037', 'path': '/dev/sdg'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135653334363037', 'path': '/dev/sdg'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'flavor' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:21:55 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:21:55 user nova-compute[74882]:   <source dev="/dev/sdg"/>
Nov 21 14:21:55 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:21:55 user nova-compute[74882]:   <serial>0ba22751-58d1-456d-be4d-ddcb85ff1a4f</serial>
Nov 21 14:21:55 user nova-compute[74882]: </disk>
Nov 21 14:21:55 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:21:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No VIF found with MAC fa:16:3e:d8:3b:23, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:21:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85bb59d-5c3d-4a9f-8be4-c8474b18a2eb tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.252s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:21:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:21:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'flavor' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:02 user nova-compute[74882]: INFO nova.compute.manager [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Attaching volume a3e31898-7f58-497f-b331-c17c694f2e54 to /dev/vdc
Nov 21 14:22:02 user nova-compute[74882]: DEBUG os_brick.utils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f905fbf-749c-4ee1-89a5-45ee0ffff72d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81188d8-9334-4c99-a369-d32ef7c6b1f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2408db6d-a0b4-4163-b60a-14f713159ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5fcfaf-eb8b-419f-82d2-b207409369a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:22:02 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:22:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[18544f7d-5905-4e20-adde-126524c1de3e]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG os_brick.utils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:22:02 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updating existing volume attachment record: 0c36d700-8639-4027-8f31-c45687a9b80c {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:22:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdZoIHOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:22:09 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:22:09 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:22:09 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f01abd0-edf2-48fa-863e-b7108668c227]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:22:09 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbefc9e-0605-4501-9bad-a3cf1f82fba8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54] added
Nov 21 14:22:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[559ab579-726e-451c-8e82-1f2d82caf945]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a12f03-fc5e-4b53-9328-32526f981139]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdZoIHOB {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdZoIHOB" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2172bba5-1739-49f9-a544-94ba4a1b83b9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wdZoIHOB'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[43117af6-db53-42a4-9dc5-65a8659bf126]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1077026c-7d5e-4924-9b31-1dfcfb9650a1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cc0a0f-8b76-4b75-9364-f0085b1a2959]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260]
Nov 21 14:22:09 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260] successful.
Nov 21 14:22:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eda05b-d6a5-44ae-997d-4bac946e49b9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf3272b-dd64-4e74-af16-b073feaaa61d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 (non-flash)
Nov 21 14:22:09 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aee988a-29f1-417c-8e0f-afdd7c9e5ad5]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:22:10 user nova-compute[74882]: INFO nova.compute.claims [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Claim successful on node user
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.090s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:22:10 user nova-compute[74882]: INFO nova.compute.claims [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Claim successful on node user
Nov 21 14:22:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdZoIHOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26366616563336564', 'path': '/dev/sdh'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366616563336564', 'path': '/dev/sdh'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'flavor' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:22:10 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:22:10 user nova-compute[74882]:   <source dev="/dev/sdh"/>
Nov 21 14:22:10 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:22:10 user nova-compute[74882]:   <serial>a3e31898-7f58-497f-b331-c17c694f2e54</serial>
Nov 21 14:22:10 user nova-compute[74882]: </disk>
Nov 21 14:22:10 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:22:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:22:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.policy [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:22:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Creating image(s)
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "/opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "/opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "/opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] No VIF found with MAC fa:16:3e:d8:3b:23, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk 1073741824" returned: 0 in 0.059s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.policy [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2169047b-d1f1-41e0-bd8d-678c78c81e61 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.282s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.228s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:22:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Creating image(s)
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "/opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Successfully created port: a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Cannot resize image /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Ensure instance console log exists: /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk 1073741824" returned: 0 in 0.049s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Successfully created port: feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:12 user nova-compute[74882]: INFO nova.compute.manager [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Detaching volume a3e31898-7f58-497f-b331-c17c694f2e54
Nov 21 14:22:12 user nova-compute[74882]: INFO nova.virt.block_device [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Attempting to driver detach volume a3e31898-7f58-497f-b331-c17c694f2e54 from mountpoint /dev/vdc
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Successfully updated port: a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Attempting to detach device vdc from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:22:12 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:22:12 user nova-compute[74882]:   <source dev="/dev/sdh"/>
Nov 21 14:22:12 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:22:12 user nova-compute[74882]:   <serial>a3e31898-7f58-497f-b331-c17c694f2e54</serial>
Nov 21 14:22:12 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 21 14:22:12 user nova-compute[74882]: </disk>
Nov 21 14:22:12 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:22:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Successfully detached device vdc from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the persistent domain config.
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:22:12 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:22:12 user nova-compute[74882]:   <source dev="/dev/sdh"/>
Nov 21 14:22:12 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:22:12 user nova-compute[74882]:   <serial>a3e31898-7f58-497f-b331-c17c694f2e54</serial>
Nov 21 14:22:12 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 21 14:22:12 user nova-compute[74882]: </disk>
Nov 21 14:22:12 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquired lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Cannot resize image /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Ensure instance console log exists: /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-changed-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Refreshing instance network info cache due to event network-changed-a9efa405-53bc-47b6-831c-8bae5302754f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Acquiring lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:22:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updating instance_info_cache with network_info: [{"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Releasing lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Instance network_info: |[{"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Acquired lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.neutron [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Refreshing network info cache for port a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Start _get_guest_xml network_info=[{"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:22:13 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:22:13 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-926413379',display_name='tempest-VolumesAdminNegativeTest-server-926413379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-926413379',id=16,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIgtT9MPdGsRerkoAmYBJprp9EZkPrFi/Tb9V24DN84MmkyPsD+E5nrKgRf83VTJ0tWnfZvruXA2QsHcBiuOnJInoeUVnqKKOtMOWNdnF/4teCiXe3ULO+8JRSuIQOh6A==',key_name='tempest-keypair-829674788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26cdaa13ed94137bcb577358a2054dc',ramdisk_id='',reservation_id='r-4k30ujdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-564618194',owner_user_name='tempest-VolumesAdminNegativeTest-564618194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85844a0bfabd4095b647684ad7a1003a',uuid=4238ef1f-4d57-472f-b902-33aae507931b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converting VIF {"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:26,bridge_name='br-int',has_traffic_filtering=True,id=a9efa405-53bc-47b6-831c-8bae5302754f,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9efa405-53') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'pci_devices' on Instance uuid 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:22:13 user nova-compute[74882]:   <uuid>4238ef1f-4d57-472f-b902-33aae507931b</uuid>
Nov 21 14:22:13 user nova-compute[74882]:   <name>instance-00000010</name>
Nov 21 14:22:13 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:22:13 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:22:13 user nova-compute[74882]:   <metadata>
Nov 21 14:22:13 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:22:13 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:name>tempest-VolumesAdminNegativeTest-server-926413379</nova:name>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:22:13</nova:creationTime>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:22:13 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:22:13 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:owner>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:user uuid="85844a0bfabd4095b647684ad7a1003a">tempest-VolumesAdminNegativeTest-564618194-project-member</nova:user>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:project uuid="a26cdaa13ed94137bcb577358a2054dc">tempest-VolumesAdminNegativeTest-564618194</nova:project>
Nov 21 14:22:13 user nova-compute[74882]:       </nova:owner>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:ports>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:port uuid="a9efa405-53bc-47b6-831c-8bae5302754f">
Nov 21 14:22:13 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 21 14:22:13 user nova-compute[74882]:         </nova:port>
Nov 21 14:22:13 user nova-compute[74882]:       </nova:ports>
Nov 21 14:22:13 user nova-compute[74882]:     </nova:instance>
Nov 21 14:22:13 user nova-compute[74882]:   </metadata>
Nov 21 14:22:13 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:22:13 user nova-compute[74882]:     <system>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="serial">4238ef1f-4d57-472f-b902-33aae507931b</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="uuid">4238ef1f-4d57-472f-b902-33aae507931b</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:22:13 user nova-compute[74882]:     </system>
Nov 21 14:22:13 user nova-compute[74882]:   </sysinfo>
Nov 21 14:22:13 user nova-compute[74882]:   <os>
Nov 21 14:22:13 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:22:13 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:22:13 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:22:13 user nova-compute[74882]:   </os>
Nov 21 14:22:13 user nova-compute[74882]:   <features>
Nov 21 14:22:13 user nova-compute[74882]:     <acpi/>
Nov 21 14:22:13 user nova-compute[74882]:     <apic/>
Nov 21 14:22:13 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:22:13 user nova-compute[74882]:   </features>
Nov 21 14:22:13 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:22:13 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:22:13 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:22:13 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:22:13 user nova-compute[74882]:   </clock>
Nov 21 14:22:13 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:22:13 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:22:13 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:22:13 user nova-compute[74882]:   </cpu>
Nov 21 14:22:13 user nova-compute[74882]:   <devices>
Nov 21 14:22:13 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:22:13 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:22:13 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk"/>
Nov 21 14:22:13 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:22:13 user nova-compute[74882]:     </disk>
Nov 21 14:22:13 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:22:13 user nova-compute[74882]:       <mac address="fa:16:3e:7d:39:26"/>
Nov 21 14:22:13 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:22:13 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:22:13 user nova-compute[74882]:       <target dev="tapa9efa405-53"/>
Nov 21 14:22:13 user nova-compute[74882]:     </interface>
Nov 21 14:22:13 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:22:13 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/console.log" append="off"/>
Nov 21 14:22:13 user nova-compute[74882]:     </serial>
Nov 21 14:22:13 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:22:13 user nova-compute[74882]:     <video>
Nov 21 14:22:13 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:22:13 user nova-compute[74882]:     </video>
Nov 21 14:22:13 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:22:13 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:22:13 user nova-compute[74882]:     </rng>
Nov 21 14:22:13 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:22:13 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:22:13 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:22:13 user nova-compute[74882]:     </memballoon>
Nov 21 14:22:13 user nova-compute[74882]:   </devices>
Nov 21 14:22:13 user nova-compute[74882]: </domain>
Nov 21 14:22:13 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-926413379',display_name='tempest-VolumesAdminNegativeTest-server-926413379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-926413379',id=16,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIgtT9MPdGsRerkoAmYBJprp9EZkPrFi/Tb9V24DN84MmkyPsD+E5nrKgRf83VTJ0tWnfZvruXA2QsHcBiuOnJInoeUVnqKKOtMOWNdnF/4teCiXe3ULO+8JRSuIQOh6A==',key_name='tempest-keypair-829674788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26cdaa13ed94137bcb577358a2054dc',ramdisk_id='',reservation_id='r-4k30ujdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-564618194',owner_user_name='tempest-VolumesAdminNegativeTest-564618194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85844a0bfabd4095b647684ad7a1003a',uuid=4238ef1f-4d57-472f-b902-33aae507931b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converting VIF {"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:26,bridge_name='br-int',has_traffic_filtering=True,id=a9efa405-53bc-47b6-831c-8bae5302754f,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9efa405-53') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG os_vif [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:26,bridge_name='br-int',has_traffic_filtering=True,id=a9efa405-53bc-47b6-831c-8bae5302754f,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9efa405-53') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85a5dc27-3067-5441-be0a-89c4bf850a3b', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9efa405-53, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9efa405-53, col_values=(('qos', UUID('11825208-c16d-43b9-b57c-ff0d4eea1aac')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9efa405-53, col_values=(('external_ids', {'iface-id': 'a9efa405-53bc-47b6-831c-8bae5302754f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:39:26', 'vm-uuid': '4238ef1f-4d57-472f-b902-33aae507931b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: INFO os_vif [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:39:26,bridge_name='br-int',has_traffic_filtering=True,id=a9efa405-53bc-47b6-831c-8bae5302754f,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9efa405-53')
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] No VIF found with MAC fa:16:3e:7d:39:26, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Successfully updated port: feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received event network-changed-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Refreshing instance network info cache due to event network-changed-feb7f672-16b6-449a-8b69-5b3ef5573e1c. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Acquiring lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updating instance_info_cache with network_info: [{"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Instance network_info: |[{"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Acquired lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.neutron [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Refreshing network info cache for port feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Start _get_guest_xml network_info=[{"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:22:13 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:22:13 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1151244324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1151244324',id=17,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-jd9gvutz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:22:12Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=eeb0740f-ac2c-44ca-9b16-d61f8f1cb968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=feb7f672-16b6-449a-8b69-5b3ef5573e1c,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb7f672-16') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'pci_devices' on Instance uuid eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:22:13 user nova-compute[74882]:   <uuid>eeb0740f-ac2c-44ca-9b16-d61f8f1cb968</uuid>
Nov 21 14:22:13 user nova-compute[74882]:   <name>instance-00000011</name>
Nov 21 14:22:13 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:22:13 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:22:13 user nova-compute[74882]:   <metadata>
Nov 21 14:22:13 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:22:13 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1151244324</nova:name>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:22:13</nova:creationTime>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:22:13 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:22:13 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:owner>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:user uuid="7635b3029cf14950a1978282d06bc8f3">tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member</nova:user>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:project uuid="96e5113ec65d46c4b8859c4658433b02">tempest-ServerBootFromVolumeStableRescueTest-1086017756</nova:project>
Nov 21 14:22:13 user nova-compute[74882]:       </nova:owner>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:22:13 user nova-compute[74882]:       <nova:ports>
Nov 21 14:22:13 user nova-compute[74882]:         <nova:port uuid="feb7f672-16b6-449a-8b69-5b3ef5573e1c">
Nov 21 14:22:13 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:22:13 user nova-compute[74882]:         </nova:port>
Nov 21 14:22:13 user nova-compute[74882]:       </nova:ports>
Nov 21 14:22:13 user nova-compute[74882]:     </nova:instance>
Nov 21 14:22:13 user nova-compute[74882]:   </metadata>
Nov 21 14:22:13 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:22:13 user nova-compute[74882]:     <system>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="serial">eeb0740f-ac2c-44ca-9b16-d61f8f1cb968</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="uuid">eeb0740f-ac2c-44ca-9b16-d61f8f1cb968</entry>
Nov 21 14:22:13 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:22:13 user nova-compute[74882]:     </system>
Nov 21 14:22:13 user nova-compute[74882]:   </sysinfo>
Nov 21 14:22:13 user nova-compute[74882]:   <os>
Nov 21 14:22:13 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:22:13 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:22:13 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:22:13 user nova-compute[74882]:   </os>
Nov 21 14:22:13 user nova-compute[74882]:   <features>
Nov 21 14:22:13 user nova-compute[74882]:     <acpi/>
Nov 21 14:22:13 user nova-compute[74882]:     <apic/>
Nov 21 14:22:13 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:22:13 user nova-compute[74882]:   </features>
Nov 21 14:22:13 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:22:13 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:22:13 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:22:13 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:22:13 user nova-compute[74882]:   </clock>
Nov 21 14:22:13 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:22:13 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:22:13 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:22:13 user nova-compute[74882]:   </cpu>
Nov 21 14:22:13 user nova-compute[74882]:   <devices>
Nov 21 14:22:13 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:22:13 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:22:13 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk"/>
Nov 21 14:22:13 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:22:13 user nova-compute[74882]:     </disk>
Nov 21 14:22:13 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:22:13 user nova-compute[74882]:       <mac address="fa:16:3e:91:90:fa"/>
Nov 21 14:22:13 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:22:13 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:22:13 user nova-compute[74882]:       <target dev="tapfeb7f672-16"/>
Nov 21 14:22:13 user nova-compute[74882]:     </interface>
Nov 21 14:22:13 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:22:13 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/console.log" append="off"/>
Nov 21 14:22:13 user nova-compute[74882]:     </serial>
Nov 21 14:22:13 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:22:13 user nova-compute[74882]:     <video>
Nov 21 14:22:13 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:22:13 user nova-compute[74882]:     </video>
Nov 21 14:22:13 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:22:13 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:22:13 user nova-compute[74882]:     </rng>
Nov 21 14:22:13 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:22:13 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:22:13 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:22:13 user nova-compute[74882]:     </memballoon>
Nov 21 14:22:13 user nova-compute[74882]:   </devices>
Nov 21 14:22:13 user nova-compute[74882]: </domain>
Nov 21 14:22:13 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1151244324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1151244324',id=17,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-jd9gvutz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:22:12Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=eeb0740f-ac2c-44ca-9b16-d61f8f1cb968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=feb7f672-16b6-449a-8b69-5b3ef5573e1c,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb7f672-16') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG os_vif [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=feb7f672-16b6-449a-8b69-5b3ef5573e1c,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb7f672-16') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9642c34-25bf-5179-9b86-0a4cb0f21df2', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeb7f672-16, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfeb7f672-16, col_values=(('qos', UUID('b1b85066-9e98-4ecd-9c9d-21fb505fd560')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfeb7f672-16, col_values=(('external_ids', {'iface-id': 'feb7f672-16b6-449a-8b69-5b3ef5573e1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:90:fa', 'vm-uuid': 'eeb0740f-ac2c-44ca-9b16-d61f8f1cb968'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:13 user nova-compute[74882]: INFO os_vif [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=feb7f672-16b6-449a-8b69-5b3ef5573e1c,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb7f672-16')
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:22:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No VIF found with MAC fa:16:3e:91:90:fa, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:22:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updated VIF entry in instance network info cache for port feb7f672-16b6-449a-8b69-5b3ef5573e1c. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:22:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updating instance_info_cache with network_info: [{"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:22:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updated VIF entry in instance network info cache for port a9efa405-53bc-47b6-831c-8bae5302754f. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:22:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updating instance_info_cache with network_info: [{"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:22:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0fb70a96-21f4-4b18-a697-ad3fa58f362a req-78bfa38e-ba42-478e-9357-e52b7dc86b98 service nova] Releasing lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:22:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c0b903a1-9678-400a-bb6d-3c50826c8ecd req-afb82fc2-11d7-467f-90a1-170c5c108592 service nova] Releasing lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] No waiting events found dispatching network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:22:15 user nova-compute[74882]: WARNING nova.compute.manager [req-5df0a117-ea36-4e2b-a415-87c723d56ba6 req-d0c623c9-0a56-42c3-b5ff-369210ae3e21 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received unexpected event network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f for instance with vm_state building and task_state spawning.
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received event network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] No waiting events found dispatching network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:22:16 user nova-compute[74882]: WARNING nova.compute.manager [req-a73f7897-19e7-4791-bc24-c4b71203cbb5 req-650f6b9a-7051-4952-a8e3-ad8b1395bf2a service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received unexpected event network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance with vm_state building and task_state spawning.
Nov 21 14:22:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:22:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] No waiting events found dispatching network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:22:17 user nova-compute[74882]: WARNING nova.compute.manager [req-23e66217-0dfb-481c-96a7-4049ef0fc1c6 req-4ad8bcf9-fea1-4d05-989a-dbf6bac0b9f2 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received unexpected event network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f for instance with vm_state building and task_state spawning.
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:22:18 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Instance spawned successfully.
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:22:18 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Instance spawned successfully.
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:22:18 user nova-compute[74882]: INFO nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Took 7.31 seconds to spawn the instance on the hypervisor.
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received event network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] No waiting events found dispatching network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:22:18 user nova-compute[74882]: WARNING nova.compute.manager [req-1d9a1f46-96db-4613-a74a-e7557a745a6e req-72986d5b-2f78-4a49-8d96-42383bc8f12c service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received unexpected event network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance with vm_state building and task_state spawning.
Nov 21 14:22:18 user nova-compute[74882]: INFO nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 21 14:22:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:22:18 user nova-compute[74882]: INFO nova.compute.manager [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Took 8.08 seconds to build instance.
Nov 21 14:22:18 user nova-compute[74882]: INFO nova.compute.manager [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Took 7.78 seconds to build instance.
Nov 21 14:22:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1d09d78-a208-46e5-82a5-5098d49354d9 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.211s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e3eb7f7e-30c8-4511-8f10-e85839c214bb tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.875s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:22:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:22:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=25.552738189697266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1ae17530-7c7f-48bf-a225-11be40152845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e29684d3-c5fd-4336-abc3-5da416e300e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4238ef1f-4d57-472f-b902-33aae507931b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:22:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:22:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:33 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1ae17530-7c7f-48bf-a225-11be40152845 is timed out.
Nov 21 14:22:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Successfully detached device vdc from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the live domain config.
Nov 21 14:22:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdZoIHOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:22:33 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[97749dc6-ad19-4901-913d-dc100dcbd6f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:22:33 user nova-compute[74882]: No targets found.
Nov 21 14:22:33 user nova-compute[74882]: iSNS:
Nov 21 14:22:33 user nova-compute[74882]: No targets found.
Nov 21 14:22:33 user nova-compute[74882]: STATIC:
Nov 21 14:22:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:22:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54
Nov 21 14:22:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:22:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5
Nov 21 14:22:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085
Nov 21 14:22:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f
Nov 21 14:22:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87
Nov 21 14:22:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:33 user nova-compute[74882]: FIRMWARE:
Nov 21 14:22:33 user nova-compute[74882]: No targets found.
Nov 21 14:22:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:22:33 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:22:33 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f718f4-6d2f-4443-89ea-d1c30e52a421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[010cfb2c-f3cd-4ac0-a963-669838e5162e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 (non-flash)
Nov 21 14:22:33 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c731630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54'): ({'sdh'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Removing single pathed devices sdh {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b997aa6f-5629-4c49-80a7-96c8789de32b]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af2f25-ecf4-46d1-8284-81a5c17f7638]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Flushing IO for device /dev/sdh {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.011s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36cebd-ce1d-4ab1-a5ac-3537a3bdd4ea]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc6328f-bd2c-4462-a1bf-5d01eca602ad]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] SCSI volumes sdh have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6e6775-94d8-454c-9324-363d47208600]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a003b0-c8a2-4a5a-8d4d-4ed242ef7353]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260]
Nov 21 14:22:33 user nova-compute[74882]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54, portal: 172.16.0.220,3260] successful.
Nov 21 14:22:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e31898-7f58-497f-b331-c17c694f2e54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c63de-277c-4522-803c-7d5ed253a1ad]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] <== disconnect_volume: return (322ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:22:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:34 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'flavor' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:22:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1f8a3c70-6d87-4efe-89c0-43c978efbec8 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.666s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:36 user nova-compute[74882]: INFO nova.compute.manager [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Detaching volume 42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:22:36 user nova-compute[74882]: INFO nova.virt.block_device [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Attempting to driver detach volume 42e5cac6-874f-4823-8631-5e556909e9ce from mountpoint /dev/vdb
Nov 21 14:22:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Attempting to detach device vdb from instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:22:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:22:36 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:22:36 user nova-compute[74882]:   <source dev="/dev/sdf"/>
Nov 21 14:22:36 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:22:36 user nova-compute[74882]:   <serial>42e5cac6-874f-4823-8631-5e556909e9ce</serial>
Nov 21 14:22:36 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:22:36 user nova-compute[74882]: </disk>
Nov 21 14:22:36 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:22:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully detached device vdb from instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee from the persistent domain config.
Nov 21 14:22:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:22:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:22:36 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:22:36 user nova-compute[74882]:   <source dev="/dev/sdf"/>
Nov 21 14:22:36 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:22:36 user nova-compute[74882]:   <serial>42e5cac6-874f-4823-8631-5e556909e9ce</serial>
Nov 21 14:22:36 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:22:36 user nova-compute[74882]: </disk>
Nov 21 14:22:36 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:22:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:22:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:56 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee is timed out.
Nov 21 14:22:56 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully detached device vdb from instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee from the live domain config.
Nov 21 14:22:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMZNHQxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:22:56 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[61511f67-c77b-49fd-af34-1dae23bdc421]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:22:56 user nova-compute[74882]: No targets found.
Nov 21 14:22:56 user nova-compute[74882]: iSNS:
Nov 21 14:22:56 user nova-compute[74882]: No targets found.
Nov 21 14:22:56 user nova-compute[74882]: STATIC:
Nov 21 14:22:56 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:22:56 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:56 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:56 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce
Nov 21 14:22:56 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:56 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:56 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5
Nov 21 14:22:56 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:56 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:56 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085
Nov 21 14:22:56 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:56 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:56 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f
Nov 21 14:22:56 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:56 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:56 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87
Nov 21 14:22:56 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:22:56 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:22:56 user nova-compute[74882]: FIRMWARE:
Nov 21 14:22:56 user nova-compute[74882]: No targets found.
Nov 21 14:22:56 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:22:56 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:22:56 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec3f307-dc59-4cbd-a4ed-4350bed068ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d86d398-5efe-4075-872c-4b734af6c74b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:56 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:22:56 user nova-compute[74882]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce (non-flash)
Nov 21 14:22:56 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6c8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce'): ({'sdf'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Removing single pathed devices sdf {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9680e6b-41b0-49be-a7f3-1c2669499084]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4e9ac3-c268-4fdb-b143-c8d21801083d]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flushing IO for device /dev/sdf {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9035a89-6718-4ce5-9ab4-734d353c8e6d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4da02d-0e1b-4863-8ce2-0cb90572b2dc]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] SCSI volumes sdf have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e64756-4c81-41b0-86a2-067abb350a89]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd825f1-c3e2-4c9b-be13-79d726b168ee]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260]
Nov 21 14:22:57 user nova-compute[74882]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce, portal: 172.16.0.220,3260] successful.
Nov 21 14:22:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e5cac6-874f-4823-8631-5e556909e9ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d817d86f-4760-49cf-b19d-71d940a087ce]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== disconnect_volume: return (391ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:22:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5314aa13-55ac-48ba-8b21-85afaeb759ec tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.116s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:22:58 user nova-compute[74882]: INFO nova.compute.claims [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Claim successful on node user
Nov 21 14:22:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:22:58 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:22:59 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.policy [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:22:59 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Creating image(s)
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.202s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-changed-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing instance network info cache due to event network-changed-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Acquiring lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Acquired lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG nova.network.neutron [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Refreshing network info cache for port b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk 1073741824" returned: 0 in 0.147s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:22:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Successfully created port: 23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Cannot resize image /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Ensure instance console log exists: /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updated VIF entry in instance network info cache for port b14ee778-12aa-4208-bcdb-9fe2d8ea2a96. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [{"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5ba303ce-8b86-4d28-8371-3b52e5a0d310 req-763aa019-47e6-4296-859b-6f7884ae0381 service nova] Releasing lock "refresh_cache-d2fbf0ae-0e14-42aa-a25b-d349726bad95" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.neutron [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Successfully updated port: 23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.neutron [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.neutron [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-changed-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Refreshing instance network info cache due to event network-changed-23e1e132-07a0-4650-9032-872a2dfeafb4. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.neutron [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance network_info: |[{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Refreshing network info cache for port 23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Start _get_guest_xml network_info=[{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:23:01 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:23:01 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.objects.instance [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lazy-loading 'pci_devices' on Instance uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:23:01 user nova-compute[74882]:   <uuid>101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</uuid>
Nov 21 14:23:01 user nova-compute[74882]:   <name>instance-00000012</name>
Nov 21 14:23:01 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:23:01 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:23:01 user nova-compute[74882]:   <metadata>
Nov 21 14:23:01 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:23:01 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:23:01 user nova-compute[74882]:       <nova:name>tempest-ServerActionsTestOtherB-server-1299552937</nova:name>
Nov 21 14:23:01 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:23:01</nova:creationTime>
Nov 21 14:23:01 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:23:01 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:23:01 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:23:01 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:23:01 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:23:01 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:23:01 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:23:01 user nova-compute[74882]:       <nova:owner>
Nov 21 14:23:01 user nova-compute[74882]:         <nova:user uuid="a19fbffc4df04656950aa2bb1a2bb48a">tempest-ServerActionsTestOtherB-2073286927-project-member</nova:user>
Nov 21 14:23:01 user nova-compute[74882]:         <nova:project uuid="ccf822369a824ed3912173b2f27fddbf">tempest-ServerActionsTestOtherB-2073286927</nova:project>
Nov 21 14:23:01 user nova-compute[74882]:       </nova:owner>
Nov 21 14:23:01 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:23:01 user nova-compute[74882]:       <nova:ports>
Nov 21 14:23:01 user nova-compute[74882]:         <nova:port uuid="23e1e132-07a0-4650-9032-872a2dfeafb4">
Nov 21 14:23:01 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 21 14:23:01 user nova-compute[74882]:         </nova:port>
Nov 21 14:23:01 user nova-compute[74882]:       </nova:ports>
Nov 21 14:23:01 user nova-compute[74882]:     </nova:instance>
Nov 21 14:23:01 user nova-compute[74882]:   </metadata>
Nov 21 14:23:01 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:23:01 user nova-compute[74882]:     <system>
Nov 21 14:23:01 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:23:01 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:23:01 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:23:01 user nova-compute[74882]:       <entry name="serial">101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</entry>
Nov 21 14:23:01 user nova-compute[74882]:       <entry name="uuid">101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</entry>
Nov 21 14:23:01 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:23:01 user nova-compute[74882]:     </system>
Nov 21 14:23:01 user nova-compute[74882]:   </sysinfo>
Nov 21 14:23:01 user nova-compute[74882]:   <os>
Nov 21 14:23:01 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:23:01 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:23:01 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:23:01 user nova-compute[74882]:   </os>
Nov 21 14:23:01 user nova-compute[74882]:   <features>
Nov 21 14:23:01 user nova-compute[74882]:     <acpi/>
Nov 21 14:23:01 user nova-compute[74882]:     <apic/>
Nov 21 14:23:01 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:23:01 user nova-compute[74882]:   </features>
Nov 21 14:23:01 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:23:01 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:23:01 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:23:01 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:23:01 user nova-compute[74882]:   </clock>
Nov 21 14:23:01 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:23:01 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:23:01 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:23:01 user nova-compute[74882]:   </cpu>
Nov 21 14:23:01 user nova-compute[74882]:   <devices>
Nov 21 14:23:01 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:23:01 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:23:01 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk"/>
Nov 21 14:23:01 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:23:01 user nova-compute[74882]:     </disk>
Nov 21 14:23:01 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:23:01 user nova-compute[74882]:       <mac address="fa:16:3e:c6:d9:99"/>
Nov 21 14:23:01 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:23:01 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:23:01 user nova-compute[74882]:       <target dev="tap23e1e132-07"/>
Nov 21 14:23:01 user nova-compute[74882]:     </interface>
Nov 21 14:23:01 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:23:01 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/console.log" append="off"/>
Nov 21 14:23:01 user nova-compute[74882]:     </serial>
Nov 21 14:23:01 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:23:01 user nova-compute[74882]:     <video>
Nov 21 14:23:01 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:23:01 user nova-compute[74882]:     </video>
Nov 21 14:23:01 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:23:01 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:23:01 user nova-compute[74882]:     </rng>
Nov 21 14:23:01 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:23:01 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:23:01 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:23:01 user nova-compute[74882]:     </memballoon>
Nov 21 14:23:01 user nova-compute[74882]:   </devices>
Nov 21 14:23:01 user nova-compute[74882]: </domain>
Nov 21 14:23:01 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:23:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG os_vif [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59bb2502-597a-5fb4-8ec5-6e43ac1122fd', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23e1e132-07, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23e1e132-07, col_values=(('qos', UUID('bddb8c1c-08eb-4849-b881-0cc5d6dd4585')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23e1e132-07, col_values=(('external_ids', {'iface-id': '23e1e132-07a0-4650-9032-872a2dfeafb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:d9:99', 'vm-uuid': '101c9eaa-a8f5-4840-a1d7-454b0be5d5d0'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: INFO os_vif [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07')
Nov 21 14:23:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No VIF found with MAC fa:16:3e:c6:d9:99, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG nova.network.neutron [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updated VIF entry in instance network info cache for port 23e1e132-07a0-4650-9032-872a2dfeafb4. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG nova.network.neutron [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eec5742f-6fac-4f41-91bc-87c1ea3803cf req-f2c2745a-dfa2-48d6-974c-5e0062beadae service nova] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:02 user nova-compute[74882]: INFO nova.compute.manager [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Terminating instance
Nov 21 14:23:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:03 user nova-compute[74882]: INFO nova.compute.manager [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Detaching volume 0ba22751-58d1-456d-be4d-ddcb85ff1a4f
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: INFO nova.virt.block_device [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Attempting to driver detach volume 0ba22751-58d1-456d-be4d-ddcb85ff1a4f from mountpoint /dev/vdb
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-unplugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-700cb3ad-5aa0-4a58-96b7-f33efaf4e355 req-8c31abd5-4eaf-4313-bbaa-a762cf5fdf38 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-29164a1e-6f52-4e02-8bf9-af322c771dab for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Attempting to detach device vdb from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:23:03 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:03 user nova-compute[74882]:   <source dev="/dev/sdg"/>
Nov 21 14:23:03 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:23:03 user nova-compute[74882]:   <serial>0ba22751-58d1-456d-be4d-ddcb85ff1a4f</serial>
Nov 21 14:23:03 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:23:03 user nova-compute[74882]: </disk>
Nov 21 14:23:03 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:23:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Successfully detached device vdb from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the persistent domain config.
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:23:03 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:03 user nova-compute[74882]:   <source dev="/dev/sdg"/>
Nov 21 14:23:03 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:23:03 user nova-compute[74882]:   <serial>0ba22751-58d1-456d-be4d-ddcb85ff1a4f</serial>
Nov 21 14:23:03 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:23:03 user nova-compute[74882]: </disk>
Nov 21 14:23:03 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-unplugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-fd43de5a-65c9-4acb-a371-b6dc417d8df5 req-8b781791-69ff-4373-b1ed-defa05974be7 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Instance destroyed successfully.
Nov 21 14:23:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lazy-loading 'resources' on Instance uuid d2fbf0ae-0e14-42aa-a25b-d349726bad95 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:63:75,bridge_name='br-int',has_traffic_filtering=True,id=b14ee778-12aa-4208-bcdb-9fe2d8ea2a96,network=Network(f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ee778-12') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:63:75,bridge_name='br-int',has_traffic_filtering=True,id=b14ee778-12aa-4208-bcdb-9fe2d8ea2a96,network=Network(f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ee778-12') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14ee778-12, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe0ff2a9-a4e4-4e98-bc35-f29030edb75a) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: INFO os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:63:75,bridge_name='br-int',has_traffic_filtering=True,id=b14ee778-12aa-4208-bcdb-9fe2d8ea2a96,network=Network(f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14ee778-12')
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=29164a1e-6f52-4e02-8bf9-af322c771dab,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap29164a1e-6f') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=29164a1e-6f52-4e02-8bf9-af322c771dab,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap29164a1e-6f') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29164a1e-6f, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4125bb7-0037-44bb-908d-784e44a69af4) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-29164a1e-6f52-4e02-8bf9-af322c771dab for instance with vm_state active and task_state deleting.
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-unplugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-c17f8fb0-313c-44e4-8d06-df35a52d365d for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-c17f8fb0-313c-44e4-8d06-df35a52d365d for instance with vm_state active and task_state deleting.
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-unplugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-cdccaae8-da2c-4767-b3da-21c792e1c4ce for instance with vm_state active and task_state deleting.
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-unplugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-a7ca135d-1184-4166-b185-bb4acf34d4bc for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-a7ca135d-1184-4166-b185-bb4acf34d4bc for instance with vm_state active and task_state deleting.
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state building and task_state spawning.
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING nova.compute.manager [req-e4f0e86f-6cf6-4593-91fc-01c74b9f46df req-87e58e0c-98de-472b-993b-383cc1c9e11e service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state building and task_state spawning.
Nov 21 14:23:05 user nova-compute[74882]: INFO os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:fe:e9,bridge_name='br-int',has_traffic_filtering=True,id=29164a1e-6f52-4e02-8bf9-af322c771dab,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap29164a1e-6f')
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:4e,bridge_name='br-int',has_traffic_filtering=True,id=f3d78a1a-34cd-4673-ac41-572a523c57c0,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3d78a1a-34') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:4e,bridge_name='br-int',has_traffic_filtering=True,id=f3d78a1a-34cd-4673-ac41-572a523c57c0,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3d78a1a-34') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3d78a1a-34, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e624b974-e94c-4a93-84b0-97405b8b5ad3) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: INFO os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:4e,bridge_name='br-int',has_traffic_filtering=True,id=f3d78a1a-34cd-4673-ac41-572a523c57c0,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3d78a1a-34')
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:37:8c,bridge_name='br-int',has_traffic_filtering=True,id=c17f8fb0-313c-44e4-8d06-df35a52d365d,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f8fb0-31') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:37:8c,bridge_name='br-int',has_traffic_filtering=True,id=c17f8fb0-313c-44e4-8d06-df35a52d365d,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f8fb0-31') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc17f8fb0-31, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c3ee9f2-7d38-4d1c-b686-7f265660d152) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: INFO os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:37:8c,bridge_name='br-int',has_traffic_filtering=True,id=c17f8fb0-313c-44e4-8d06-df35a52d365d,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc17f8fb0-31')
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=19c29b2e-3376-4dd9-9ccb-233249c5bc67,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c29b2e-33') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=19c29b2e-3376-4dd9-9ccb-233249c5bc67,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c29b2e-33') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19c29b2e-33, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ffd83b3-5a0f-4418-ba08-61a5455b3c6b) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING nova.compute.manager [req-6c08d4cf-ba36-43fe-8142-33479e6d4917 req-50626858-408f-46e9-bcf6-7df857edf02d service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-19c29b2e-3376-4dd9-9ccb-233249c5bc67 for instance with vm_state active and task_state deleting.
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: INFO os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:22:8a,bridge_name='br-int',has_traffic_filtering=True,id=19c29b2e-3376-4dd9-9ccb-233249c5bc67,network=Network(addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19c29b2e-33')
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=cdccaae8-da2c-4767-b3da-21c792e1c4ce,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdccaae8-da') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=cdccaae8-da2c-4767-b3da-21c792e1c4ce,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdccaae8-da') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdccaae8-da, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96695f0e-1044-4265-b8a4-da79deeb5b98) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: INFO os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:b1:b8,bridge_name='br-int',has_traffic_filtering=True,id=cdccaae8-da2c-4767-b3da-21c792e1c4ce,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdccaae8-da')
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-21T14:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1960452780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1960452780',id=14,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXmiWis7OQOmNxSOenJ2A+CgGyw/EwkDoSdTlAeeF1zHchtzms6qEpvPul0McCSjAYo9mfn5mVrNf579BY5oOYUGaTe3FTB4Xcoc+qGsWHOE4GeW5UZyzubDeHnTml/MA==',key_name='tempest-keypair-1738218210',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b45a2561f064eedb95133a91c79585e',ramdisk_id='',reservation_id='r-1xtej3yu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1073959102',owner_user_name='tempest-TaggedBootDevicesTest-1073959102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:21:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1448e4787c2c4c0bb6c3e1f7241246e7',uuid=d2fbf0ae-0e14-42aa-a25b-d349726bad95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converting VIF {"id": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "address": "fa:16:3e:d9:8d:a7", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ca135d-11", "ovs_interfaceid": "a7ca135d-1184-4166-b185-bb4acf34d4bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a7ca135d-1184-4166-b185-bb4acf34d4bc,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ca135d-11') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a7ca135d-1184-4166-b185-bb4acf34d4bc,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ca135d-11') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7ca135d-11, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bd0eb24-ef92-44ef-bb97-b578607a0fc5) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:05 user nova-compute[74882]: INFO os_vif [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:8d:a7,bridge_name='br-int',has_traffic_filtering=True,id=a7ca135d-1184-4166-b185-bb4acf34d4bc,network=Network(35f76db6-4bab-4690-87a0-25042e3aea04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ca135d-11')
Nov 21 14:23:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFnvCbyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:05 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4b2161-9614-47fc-8f4a-f540e244f73d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:23:05 user nova-compute[74882]: No targets found.
Nov 21 14:23:05 user nova-compute[74882]: iSNS:
Nov 21 14:23:05 user nova-compute[74882]: No targets found.
Nov 21 14:23:05 user nova-compute[74882]: STATIC:
Nov 21 14:23:05 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:05 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:05 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:05 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5
Nov 21 14:23:05 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:05 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:05 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085
Nov 21 14:23:05 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:05 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:05 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f
Nov 21 14:23:05 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:05 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:05 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87
Nov 21 14:23:05 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:05 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:05 user nova-compute[74882]: FIRMWARE:
Nov 21 14:23:05 user nova-compute[74882]: No targets found.
Nov 21 14:23:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:23:05 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:23:05 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f13897-fbcd-4d21-9117-86877ea60eff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f81bac-5d2e-4918-a536-7e26541a5558]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:05 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c6564d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8435ae0f-b671-4be9-a2dd-e2147950c850]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e46b746-615f-48b2-a0a5-69a68bcd1fcc]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcfbc73-f010-4ee9-9c5b-c24e32194015]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:23:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[718dd14d-8694-45bf-95ab-dc2df9c954e8]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be42429-8a3d-450e-9a20-f0521370fae9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b4efe-b618-4eb6-abe5-66672259b65f]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260]
Nov 21 14:23:06 user nova-compute[74882]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55f6cd42-6971-4118-bd73-a6b5bd162c87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ab2f5-9901-416a-acab-b31314a85c3b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== disconnect_volume: return (396ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'notCmXrx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c01f3f-ed1d-4a63-aac7-1f11cf339ae7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:23:06 user nova-compute[74882]: No targets found.
Nov 21 14:23:06 user nova-compute[74882]: iSNS:
Nov 21 14:23:06 user nova-compute[74882]: No targets found.
Nov 21 14:23:06 user nova-compute[74882]: STATIC:
Nov 21 14:23:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5
Nov 21 14:23:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085
Nov 21 14:23:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f
Nov 21 14:23:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:06 user nova-compute[74882]: FIRMWARE:
Nov 21 14:23:06 user nova-compute[74882]: No targets found.
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:23:06 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:23:06 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f402998-03ad-41d6-a4ef-e293ec3fc9dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9faa1a-f9b5-4f7e-ae3f-fb1c7bfe3e13]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c6564d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ef6420-41bf-457a-a918-a5d7a0d5411a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb1a5d7-7925-41fd-9aab-9cec27811327]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8273e7d7-e4da-43c5-a1c3-b34c92675ff1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d6a39-20d0-46ab-ad05-3763b09bf6ad]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83012cf-8adb-48f9-b297-63b55308ec62]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2572460d-7efa-4d4b-a5ed-9f3b2691b87e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260]
Nov 21 14:23:06 user nova-compute[74882]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e12c01ce-49fb-4570-88d1-9d57881b22e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaa5497-9b10-4fdb-96d7-08e9675aa0f5]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== disconnect_volume: return (327ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADULiSFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d07708-36f6-40b5-a47d-084eea01f03a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:23:06 user nova-compute[74882]: No targets found.
Nov 21 14:23:06 user nova-compute[74882]: iSNS:
Nov 21 14:23:06 user nova-compute[74882]: No targets found.
Nov 21 14:23:06 user nova-compute[74882]: STATIC:
Nov 21 14:23:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085
Nov 21 14:23:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f
Nov 21 14:23:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:06 user nova-compute[74882]: FIRMWARE:
Nov 21 14:23:06 user nova-compute[74882]: No targets found.
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:23:06 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:23:06 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-unplugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-77d3d317-266c-4687-8c19-ca47497aac2e req-2e546915-9be7-4574-8f56-a3076ea28795 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[056410b1-eba1-43d8-b84e-4419e4a436e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed0e88e-f00d-4518-99ab-4beb56e4b7a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:06 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c3891b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98794097-cfe5-41f0-951d-298d8ffaffd5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[edff7bac-f0a6-4297-93f8-da6e59e661a5]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e13432-df96-4872-95c5-c810a25b9655]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15853d88-b4ab-47f1-bcbd-1660325d010d]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d2b98-3530-49dc-ad6e-314348539ecf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:23:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance spawned successfully.
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5ecc5e-4da3-4899-b041-8ded2338d915]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260]
Nov 21 14:23:06 user nova-compute[74882]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8c51fdd-7afa-44f1-8481-cd70f9fdc085 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c9629a-7214-4583-a18a-c958b09a36cc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] <== disconnect_volume: return (343ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:23:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Deleting instance files /opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95_del
Nov 21 14:23:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Deletion of /opt/stack/data/nova/instances/d2fbf0ae-0e14-42aa-a25b-d349726bad95_del complete
Nov 21 14:23:06 user nova-compute[74882]: INFO nova.compute.manager [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Took 4.21 seconds to destroy the instance on the hypervisor.
Nov 21 14:23:06 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:23:06 user nova-compute[74882]: INFO nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Took 7.66 seconds to spawn the instance on the hypervisor.
Nov 21 14:23:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:23:07 user nova-compute[74882]: INFO nova.compute.manager [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Took 8.57 seconds to build instance.
Nov 21 14:23:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-cc8c1f28-dfdd-4435-bda0-b8bc582f2353 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.681s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:08 user nova-compute[74882]: WARNING nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 for instance with vm_state active and task_state deleting.
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-unplugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-unplugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Acquiring lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] No waiting events found dispatching network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:08 user nova-compute[74882]: WARNING nova.compute.manager [req-61c48e3c-1f76-452c-b1b1-93eab3b93d0e req-7a3ea84b-0f7a-4692-b012-88385ff29608 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received unexpected event network-vif-plugged-f3d78a1a-34cd-4673-ac41-572a523c57c0 for instance with vm_state active and task_state deleting.
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-deleted-a7ca135d-1184-4166-b185-bb4acf34d4bc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:08 user nova-compute[74882]: INFO nova.compute.manager [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Neutron deleted interface a7ca135d-1184-4166-b185-bb4acf34d4bc; detaching it from the instance and deleting it from the info cache
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.network.neutron [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [{"id": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "address": "fa:16:3e:bd:63:75", "network": {"id": "f6d3e39a-7545-4e19-bf95-3ce5a86b5aa0", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-397693031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14ee778-12", "ovs_interfaceid": "b14ee778-12aa-4208-bcdb-9fe2d8ea2a96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29164a1e-6f52-4e02-8bf9-af322c771dab", "address": "fa:16:3e:35:fe:e9", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29164a1e-6f", "ovs_interfaceid": "29164a1e-6f52-4e02-8bf9-af322c771dab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "address": "fa:16:3e:78:27:4e", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d78a1a-34", "ovs_interfaceid": "f3d78a1a-34cd-4673-ac41-572a523c57c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "address": "fa:16:3e:69:37:8c", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc17f8fb0-31", "ovs_interfaceid": "c17f8fb0-313c-44e4-8d06-df35a52d365d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "address": "fa:16:3e:c1:22:8a", "network": {"id": "addaa4b5-ee6c-4d60-a1f2-9d061b6e20cc", "bridge": "br-int", "label": "tempest-device-tagging-net1-654760279", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19c29b2e-33", "ovs_interfaceid": "19c29b2e-3376-4dd9-9ccb-233249c5bc67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "address": "fa:16:3e:14:b1:b8", "network": {"id": "35f76db6-4bab-4690-87a0-25042e3aea04", "bridge": "br-int", "label": "tempest-device-tagging-net2-148429353", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b45a2561f064eedb95133a91c79585e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdccaae8-da", "ovs_interfaceid": "cdccaae8-da2c-4767-b3da-21c792e1c4ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-d302adbf-0bf4-4a50-9efd-974e25c345df req-eb9c3ff6-d1e3-4196-84e8-945fc2cde9ea service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Detach interface failed, port_id=a7ca135d-1184-4166-b185-bb4acf34d4bc, reason: Instance d2fbf0ae-0e14-42aa-a25b-d349726bad95 could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:23:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:23:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:23:09 user nova-compute[74882]: INFO nova.compute.claims [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Claim successful on node user
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:23:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.policy [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff48456740444cf8aee032129cc9f087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a906ab977ca047e8aacb9c696f166a20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:23:10 user nova-compute[74882]: INFO nova.virt.block_device [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Booting with volume 3334939e-afed-4b86-8d82-eda72f7b2ff9 at /dev/vda
Nov 21 14:23:10 user nova-compute[74882]: DEBUG os_brick.utils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec9edab-4c73-4719-8450-89b93e8c9664]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eb54ce-eea8-481d-ad98-638e167cd743]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb76dac2-0659-45cb-b515-b16700c7e457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[db043c2c-fa21-4d62-92cb-258b8e3bbdd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:23:10 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:23:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179d69d-0a5c-4100-b77d-12f4939a3f3e]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG os_brick.utils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updating existing volume attachment record: 082f940c-d603-4436-abfa-9a0d3c33eebb {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:10 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Took 3.80 seconds to deallocate network for instance.
Nov 21 14:23:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-deleted-cdccaae8-da2c-4767-b3da-21c792e1c4ce {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-deleted-19c29b2e-3376-4dd9-9ccb-233249c5bc67 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-deleted-c17f8fb0-313c-44e4-8d06-df35a52d365d {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-596ee56f-6ac8-4071-9e19-9c6f221970a1 req-479157a8-ce4f-4a27-9e0f-519b2a3bd064 service nova] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Received event network-vif-deleted-b14ee778-12aa-4208-bcdb-9fe2d8ea2a96 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Successfully created port: 9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:23:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Successfully updated port: 9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquired lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-changed-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Refreshing instance network info cache due to event network-changed-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Acquiring lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updating instance_info_cache with network_info: [{"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Releasing lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance network_info: |[{"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Acquired lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:23:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Refreshing network info cache for port 9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:23:13 user nova-compute[74882]: DEBUG nova.network.neutron [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updated VIF entry in instance network info cache for port 9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:23:13 user nova-compute[74882]: DEBUG nova.network.neutron [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updating instance_info_cache with network_info: [{"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43ff4762-929a-408b-b6b1-0c022b041c72 req-5864a947-a23c-41ce-b3cb-012db808399f service nova] Releasing lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:23:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:23:18 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Creating image(s)
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Ensure instance console log exists: /opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Start _get_guest_xml network_info=[{"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9fe53976-492f-40b7-bf48-cfbfc337af0f', 'attached_at': '', 'detached_at': '', 'volume_id': '3334939e-afed-4b86-8d82-eda72f7b2ff9', 'serial': '3334939e-afed-4b86-8d82-eda72f7b2ff9'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '082f940c-d603-4436-abfa-9a0d3c33eebb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:23:18 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:23:18 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:18 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:18 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:18 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5f7a67-049c-49ac-84d9-85501b9eccc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:23:18 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[830f5321-83c7-45cf-87a7-40f2310a0ba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9] added
Nov 21 14:23:18 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807b3b8-2931-4b7a-a0cf-3321eb30ccc1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d630cf9-9ccc-48fc-aac9-37714c17740e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvMlNsDL {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvMlNsDL" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dad495-57f4-466f-a9e9-232320b30b42]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvMlNsDL'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[460deaf2-32fc-46b9-8b25-2fc0c2ba6a27]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f1cc6-7058-4060-939b-aa9c1d9bae4f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:18 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:18 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:18 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:18 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8863d1-754e-4610-93fb-51c19e8c79b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]
Nov 21 14:23:18 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:18 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32af142-f843-4823-af7f-daa333a70f26]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aad976-0481-4d2b-aaa9-af99fa4173e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:18 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:18 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:18 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:18 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:18 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:18 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa5f2d4-019a-4396-96f2-040663ce241a]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:23:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:23:19 user nova-compute[74882]: INFO nova.compute.manager [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] [instance: d2fbf0ae-0e14-42aa-a25b-d349726bad95] Took 8.72 seconds to detach 3 volumes for instance.
Nov 21 14:23:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23039633764363134', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039633764363134', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-changed-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Refreshing instance network info cache due to event network-changed-767f656d-f7c7-4ab0-8727-9c0142c27b7f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Acquiring lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Acquired lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Refreshing network info cache for port 767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2116261026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2116261026',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSSyXlzqE9HWV5D9xNCNaHAa/8qW7iQ87gDowxkTy3UZ/x+eWWMIw/Z9nomrT8J/h8Pa5O/2Fn1eQ1/iYqvGmhapWyfprtgMcYbgJpsjpLdAbOg5GOfsOa4Op/nEyakg==',key_name='tempest-keypair-993669652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a906ab977ca047e8aacb9c696f166a20',ramdisk_id='',reservation_id='r-0p86wt1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-434641624',owner_user_name='tempest-ServerActionsV293TestJSON-434641624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff48456740444cf8aee032129cc9f087',uuid=9fe53976-492f-40b7-bf48-cfbfc337af0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converting VIF {"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fe53976-492f-40b7-bf48-cfbfc337af0f {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:23:19 user nova-compute[74882]:   <uuid>9fe53976-492f-40b7-bf48-cfbfc337af0f</uuid>
Nov 21 14:23:19 user nova-compute[74882]:   <name>instance-00000013</name>
Nov 21 14:23:19 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:23:19 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:23:19 user nova-compute[74882]:   <metadata>
Nov 21 14:23:19 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:23:19 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:23:19 user nova-compute[74882]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2116261026</nova:name>
Nov 21 14:23:19 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:23:18</nova:creationTime>
Nov 21 14:23:19 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:23:19 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:23:19 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:23:19 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:23:19 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:23:19 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:23:19 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:23:19 user nova-compute[74882]:       <nova:owner>
Nov 21 14:23:19 user nova-compute[74882]:         <nova:user uuid="ff48456740444cf8aee032129cc9f087">tempest-ServerActionsV293TestJSON-434641624-project-member</nova:user>
Nov 21 14:23:19 user nova-compute[74882]:         <nova:project uuid="a906ab977ca047e8aacb9c696f166a20">tempest-ServerActionsV293TestJSON-434641624</nova:project>
Nov 21 14:23:19 user nova-compute[74882]:       </nova:owner>
Nov 21 14:23:19 user nova-compute[74882]:       <nova:ports>
Nov 21 14:23:19 user nova-compute[74882]:         <nova:port uuid="9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1">
Nov 21 14:23:19 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 21 14:23:19 user nova-compute[74882]:         </nova:port>
Nov 21 14:23:19 user nova-compute[74882]:       </nova:ports>
Nov 21 14:23:19 user nova-compute[74882]:     </nova:instance>
Nov 21 14:23:19 user nova-compute[74882]:   </metadata>
Nov 21 14:23:19 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:23:19 user nova-compute[74882]:     <system>
Nov 21 14:23:19 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:23:19 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:23:19 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:23:19 user nova-compute[74882]:       <entry name="serial">9fe53976-492f-40b7-bf48-cfbfc337af0f</entry>
Nov 21 14:23:19 user nova-compute[74882]:       <entry name="uuid">9fe53976-492f-40b7-bf48-cfbfc337af0f</entry>
Nov 21 14:23:19 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:23:19 user nova-compute[74882]:     </system>
Nov 21 14:23:19 user nova-compute[74882]:   </sysinfo>
Nov 21 14:23:19 user nova-compute[74882]:   <os>
Nov 21 14:23:19 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:23:19 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:23:19 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:23:19 user nova-compute[74882]:   </os>
Nov 21 14:23:19 user nova-compute[74882]:   <features>
Nov 21 14:23:19 user nova-compute[74882]:     <acpi/>
Nov 21 14:23:19 user nova-compute[74882]:     <apic/>
Nov 21 14:23:19 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:23:19 user nova-compute[74882]:   </features>
Nov 21 14:23:19 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:23:19 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:23:19 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:23:19 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:23:19 user nova-compute[74882]:   </clock>
Nov 21 14:23:19 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:23:19 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:23:19 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:23:19 user nova-compute[74882]:   </cpu>
Nov 21 14:23:19 user nova-compute[74882]:   <devices>
Nov 21 14:23:19 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:23:19 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:19 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:23:19 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:23:19 user nova-compute[74882]:       <serial>3334939e-afed-4b86-8d82-eda72f7b2ff9</serial>
Nov 21 14:23:19 user nova-compute[74882]:     </disk>
Nov 21 14:23:19 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:23:19 user nova-compute[74882]:       <mac address="fa:16:3e:53:e9:6f"/>
Nov 21 14:23:19 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:23:19 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:23:19 user nova-compute[74882]:       <target dev="tap9f7ae295-69"/>
Nov 21 14:23:19 user nova-compute[74882]:     </interface>
Nov 21 14:23:19 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:23:19 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f/console.log" append="off"/>
Nov 21 14:23:19 user nova-compute[74882]:     </serial>
Nov 21 14:23:19 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:23:19 user nova-compute[74882]:     <video>
Nov 21 14:23:19 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:23:19 user nova-compute[74882]:     </video>
Nov 21 14:23:19 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:23:19 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:23:19 user nova-compute[74882]:     </rng>
Nov 21 14:23:19 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:23:19 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:23:19 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:23:19 user nova-compute[74882]:     </memballoon>
Nov 21 14:23:19 user nova-compute[74882]:   </devices>
Nov 21 14:23:19 user nova-compute[74882]: </domain>
Nov 21 14:23:19 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2116261026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2116261026',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSSyXlzqE9HWV5D9xNCNaHAa/8qW7iQ87gDowxkTy3UZ/x+eWWMIw/Z9nomrT8J/h8Pa5O/2Fn1eQ1/iYqvGmhapWyfprtgMcYbgJpsjpLdAbOg5GOfsOa4Op/nEyakg==',key_name='tempest-keypair-993669652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a906ab977ca047e8aacb9c696f166a20',ramdisk_id='',reservation_id='r-0p86wt1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-434641624',owner_user_name='tempest-ServerActionsV293TestJSON-434641624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff48456740444cf8aee032129cc9f087',uuid=9fe53976-492f-40b7-bf48-cfbfc337af0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converting VIF {"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG os_vif [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43e14c8b-60f6-537b-bf79-8b85bfdcceec', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f7ae295-69, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f7ae295-69, col_values=(('qos', UUID('f005722a-9dc2-4a95-a4a6-9d880682542b')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f7ae295-69, col_values=(('external_ids', {'iface-id': '9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:e9:6f', 'vm-uuid': '9fe53976-492f-40b7-bf48-cfbfc337af0f'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:19 user nova-compute[74882]: INFO os_vif [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69')
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] No VIF found with MAC fa:16:3e:53:e9:6f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:23:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:19 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Deleted allocations for instance d2fbf0ae-0e14-42aa-a25b-d349726bad95
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e679540a-bd77-40cc-bec1-13cab5987e6c tempest-TaggedBootDevicesTest-1073959102 tempest-TaggedBootDevicesTest-1073959102-project-member] Lock "d2fbf0ae-0e14-42aa-a25b-d349726bad95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.337s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG nova.network.neutron [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updated VIF entry in instance network info cache for port 767f656d-f7c7-4ab0-8727-9c0142c27b7f. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG nova.network.neutron [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updating instance_info_cache with network_info: [{"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG nova.objects.instance [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'flavor' on Instance uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43ea8f04-42df-48a5-9f7b-aa3caca00511 req-4d4b43a2-f4a5-4d44-b4d9-6c98f802dc42 service nova] Releasing lock "refresh_cache-e29684d3-c5fd-4336-abc3-5da416e300e2" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:20 user nova-compute[74882]: INFO nova.compute.manager [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Attaching volume d6daff34-cae1-4f15-a582-55aeaead48de to /dev/vdb
Nov 21 14:23:20 user nova-compute[74882]: DEBUG os_brick.utils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4f1160-03e2-408c-a052-169d6a824bb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d5fd80-7311-4ff1-b948-b2f41687eccf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[179d7f5a-ecc8-4eb4-9c7b-038e43cfbc26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d8283e-b50f-44d4-be82-bb2b84b0bc7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:23:20 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:23:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb23d22-e722-495c-b534-46603c191b1c]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG os_brick.utils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:20 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updating existing volume attachment record: 3e4b0f3f-cacf-487a-8950-69cd2eaeb2f1 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG nova.compute.manager [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG nova.compute.manager [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:21 user nova-compute[74882]: WARNING nova.compute.manager [req-abace4c4-34f4-4a87-89c2-4839fdb4b93a req-76e95ab1-c990-47f2-9222-5cb38f357185 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received unexpected event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with vm_state building and task_state spawning.
Nov 21 14:23:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:23 user nova-compute[74882]: WARNING nova.compute.manager [req-a12f2a59-4f5c-4bef-8c4e-5f82628f3522 req-a3b5ca8a-df9b-4eb3-af89-f03fe6bd1f36 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received unexpected event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with vm_state building and task_state spawning.
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:23:23 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance spawned successfully.
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:23 user nova-compute[74882]: INFO nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 21 14:23:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:23:23 user nova-compute[74882]: INFO nova.compute.manager [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Took 14.15 seconds to build instance.
Nov 21 14:23:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2c44cba1-3bbf-4549-987d-082c2cd44743 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.251s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:24 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ae17530-7c7f-48bf-a225-11be40152845 is timed out.
Nov 21 14:23:24 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Successfully detached device vdb from instance 1ae17530-7c7f-48bf-a225-11be40152845 from the live domain config.
Nov 21 14:23:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GboLInMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:24 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce4c611-3dd8-4e20-b7b2-1efc3dc59946]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:23:24 user nova-compute[74882]: No targets found.
Nov 21 14:23:24 user nova-compute[74882]: iSNS:
Nov 21 14:23:24 user nova-compute[74882]: No targets found.
Nov 21 14:23:24 user nova-compute[74882]: STATIC:
Nov 21 14:23:24 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:24 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:24 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:24 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:23:24 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:24 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:24 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f
Nov 21 14:23:24 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:24 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:24 user nova-compute[74882]: FIRMWARE:
Nov 21 14:23:24 user nova-compute[74882]: No targets found.
Nov 21 14:23:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:23:24 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:23:24 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f771634b-a20d-4663-a373-07ca358b2127]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8a8e8-581e-41a2-a03b-7a3989c0a19c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:24 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:24 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:24 user nova-compute[74882]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f (non-flash)
Nov 21 14:23:24 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6caa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f'): ({'sdg'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Removing single pathed devices sdg {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd8a6ec-8a74-4d97-ad38-b318945f546d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6161c459-aef2-4cba-ae10-bb37a3bea96e]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Flushing IO for device /dev/sdg {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a52c8-2443-4623-9cc1-0886844f82dc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ac270-67d6-42a7-8c05-ffc84797deba]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] SCSI volumes sdg have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd628e1e-dd42-4275-8abf-a149e6dab357]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.117s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8202d-3ca0-4011-acb6-c152975c390e]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260]
Nov 21 14:23:24 user nova-compute[74882]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba22751-58d1-456d-be4d-ddcb85ff1a4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d71f7-e993-4fd5-ae03-5e4d6d7151bf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] <== disconnect_volume: return (383ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:23:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:25 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'flavor' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f5405c2a-0d45-4510-a9cf-4c87a1a6aec1 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.317s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:26 user nova-compute[74882]: INFO nova.compute.manager [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Terminating instance
Nov 21 14:23:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-vif-unplugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] No waiting events found dispatching network-vif-unplugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-30748c7a-fd51-4c40-9f2b-2728c44ceefd req-351d7a70-60ab-4bfe-a81d-cdce1e0b61f8 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-vif-unplugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:27 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[85416170-3855-4c27-8c1a-f5cad6cddd3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:23:27 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Instance destroyed successfully.
Nov 21 14:23:27 user nova-compute[74882]: DEBUG nova.objects.instance [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'resources' on Instance uuid f657a1d0-b67a-4cd6-ba3c-b801abedd8ee {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-430908517',display_name='tempest-AttachVolumeNegativeTest-server-430908517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-430908517',id=3,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwY//FreJ5qDC5lWo3bwL5cUVIrBloEThhGKinIL+Dcf3C1HRYL3HegVVTngLnHoOvc8ShLJ5l6nAqbLePxabslB+xeTUT15JkeNlYIhWq4vIcEL9qSUPo7AAdHWi+/Ag==',key_name='tempest-keypair-505302143',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-vo99i1x4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=f657a1d0-b67a-4cd6-ba3c-b801abedd8ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "address": "fa:16:3e:47:e6:25", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0cf7d6d-fa", "ovs_interfaceid": "c0cf7d6d-fa0c-42c8-b031-069446ad2314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:e6:25,bridge_name='br-int',has_traffic_filtering=True,id=c0cf7d6d-fa0c-42c8-b031-069446ad2314,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf7d6d-fa') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_vif [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:e6:25,bridge_name='br-int',has_traffic_filtering=True,id=c0cf7d6d-fa0c-42c8-b031-069446ad2314,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf7d6d-fa') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[569945e5-5527-4e8d-b43b-c83c78881a15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de] added
Nov 21 14:23:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0cf7d6d-fa, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e55f60de-2fca-4f2d-977b-d719375fd94a) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:27 user nova-compute[74882]: INFO os_vif [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:e6:25,bridge_name='br-int',has_traffic_filtering=True,id=c0cf7d6d-fa0c-42c8-b031-069446ad2314,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0cf7d6d-fa')
Nov 21 14:23:27 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Deleting instance files /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee_del
Nov 21 14:23:27 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Deletion of /opt/stack/data/nova/instances/f657a1d0-b67a-4cd6-ba3c-b801abedd8ee_del complete
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfe9162-1319-40a6-b779-aba146ba8e4d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b1b9db-99af-4d07-b16b-a126406bc029]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQGEHoPB {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQGEHoPB" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b888757-694b-4e96-9084-2b1428da5471]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQGEHoPB'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: INFO nova.compute.manager [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[df615e89-8a2d-4943-8dc1-80eb4d5025d8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[90649df4-c1d0-42d8-bbd3-ef9fe943d825]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c9e97-a981-458d-b332-cb69d9c12e0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]
Nov 21 14:23:27 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ccb717-7aa6-4c1c-aa19-72a8dba509ee]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0611a47-004f-47b5-a4c2-be444b998fee]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:27 user nova-compute[74882]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a1fe9-d2ac-4bd3-a066-4fc66e88ed32]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:28 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Took 0.99 seconds to deallocate network for instance.
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-vif-deleted-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:28 user nova-compute[74882]: INFO nova.compute.manager [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Neutron deleted interface c0cf7d6d-fa0c-42c8-b031-069446ad2314; detaching it from the instance and deleting it from the info cache
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.network.neutron [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-df99f22b-381c-4da2-94ca-8037c9a1a0ae req-b3128841-a69a-41bc-9dc8-d83f661fc62a service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Detach interface failed, port_id=c0cf7d6d-fa0c-42c8-b031-069446ad2314, reason: Instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23235653933646236', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235653933646236', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'flavor' on Instance uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:23:28 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:28 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:23:28 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:23:28 user nova-compute[74882]:   <serial>d6daff34-cae1-4f15-a582-55aeaead48de</serial>
Nov 21 14:23:28 user nova-compute[74882]: </disk>
Nov 21 14:23:28 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received event network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Acquiring lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] No waiting events found dispatching network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:28 user nova-compute[74882]: WARNING nova.compute.manager [req-b6717e0e-0cf7-4dd8-aecf-5ab3277d0fc5 req-0b3257b8-0b84-41e5-8f4f-e45ff2b277c9 service nova] [instance: f657a1d0-b67a-4cd6-ba3c-b801abedd8ee] Received unexpected event network-vif-plugged-c0cf7d6d-fa0c-42c8-b031-069446ad2314 for instance with vm_state deleted and task_state None.
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:28 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.568s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No VIF found with MAC fa:16:3e:96:4e:f2, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:23:29 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Deleted allocations for instance f657a1d0-b67a-4cd6-ba3c-b801abedd8ee
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d667e3fc-98a2-4d18-88b8-1b7f71b8782b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "f657a1d0-b67a-4cd6-ba3c-b801abedd8ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.820s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-30ad7db4-1a38-42d0-b742-867bde9985bc tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.802s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Error from libvirt while getting description of instance-00000003: [Error Code 42] Domain not found: no domain with matching uuid 'f657a1d0-b67a-4cd6-ba3c-b801abedd8ee' (instance-00000003): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f657a1d0-b67a-4cd6-ba3c-b801abedd8ee' (instance-00000003)
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:29 user nova-compute[74882]: INFO nova.compute.manager [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Detaching volume 949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:29 user nova-compute[74882]: INFO nova.virt.block_device [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Attempting to driver detach volume 949666e2-574c-4f9a-bad7-2074e7b4d4b4 from mountpoint /dev/vdb
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Attempting to detach device vdb from instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:23:29 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:29 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:23:29 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:23:29 user nova-compute[74882]:   <serial>949666e2-574c-4f9a-bad7-2074e7b4d4b4</serial>
Nov 21 14:23:29 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:23:29 user nova-compute[74882]: </disk>
Nov 21 14:23:29 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:23:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully detached device vdb from instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 from the persistent domain config.
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:23:29 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:29 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:23:29 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:23:29 user nova-compute[74882]:   <serial>949666e2-574c-4f9a-bad7-2074e7b4d4b4</serial>
Nov 21 14:23:29 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:23:29 user nova-compute[74882]: </disk>
Nov 21 14:23:29 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:31 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:23:31 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7489MB free_disk=25.45478057861328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1ae17530-7c7f-48bf-a225-11be40152845 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e29684d3-c5fd-4336-abc3-5da416e300e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4238ef1f-4d57-472f-b902-33aae507931b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9fe53976-492f-40b7-bf48-cfbfc337af0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:23:31 user nova-compute[74882]: INFO nova.compute.manager [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Rebuilding instance
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-unplugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-unplugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:32 user nova-compute[74882]: WARNING nova.compute.manager [req-c31f0aba-398e-4ff0-abac-15cc4bed40c9 req-c8d0286b-5a0f-452b-881b-6e27f88c00a6 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received unexpected event network-vif-unplugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with vm_state active and task_state rebuilding.
Nov 21 14:23:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:32 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance destroyed successfully.
Nov 21 14:23:32 user nova-compute[74882]: INFO nova.compute.manager [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Detaching volume d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:23:32 user nova-compute[74882]: INFO nova.virt.block_device [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Attempting to driver detach volume d6daff34-cae1-4f15-a582-55aeaead48de from mountpoint /dev/vdb
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Attempting to detach device vdb from instance e29684d3-c5fd-4336-abc3-5da416e300e2 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:23:32 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:32 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:23:32 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:23:32 user nova-compute[74882]:   <serial>d6daff34-cae1-4f15-a582-55aeaead48de</serial>
Nov 21 14:23:32 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:23:32 user nova-compute[74882]: </disk>
Nov 21 14:23:32 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:23:32 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully detached device vdb from instance e29684d3-c5fd-4336-abc3-5da416e300e2 from the persistent domain config.
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:32 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc09d63f-eed8-4421-adaa-5ab1e862a82c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:23:32 user nova-compute[74882]: No targets found.
Nov 21 14:23:32 user nova-compute[74882]: iSNS:
Nov 21 14:23:32 user nova-compute[74882]: No targets found.
Nov 21 14:23:32 user nova-compute[74882]: STATIC:
Nov 21 14:23:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:23:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:23:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:32 user nova-compute[74882]: FIRMWARE:
Nov 21 14:23:32 user nova-compute[74882]: No targets found.
Nov 21 14:23:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:23:32 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:23:32 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b9104-e01c-4a48-a559-484ae759d8b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[208e1f06-c704-4e37-af33-609e30d43c6e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:32 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:32 user nova-compute[74882]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:32 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:32 user nova-compute[74882]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c5576d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e6419d-f885-42c0-8d01-0cd974fe4850]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dfc81b-1336-454f-8485-142a532d0002]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[576ac06c-e97e-4af0-a761-08bd8be43892]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e717986-de9f-48d1-b8d1-fe4d68b40b57]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[704ab901-ad48-4077-9634-6141f01eb3c3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6a3b4a-c3f2-404f-a1e6-f8747d51bf8b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]
Nov 21 14:23:33 user nova-compute[74882]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd6358b-53d0-4d95-be4d-b80be6421ce6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== disconnect_volume: return (339ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:23:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance destroyed successfully.
Nov 21 14:23:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099597183',display_name='tempest-ServerActionsTestOtherA-server-550921415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099597183',id=15,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8mqZtU9dDhvCuVjxEIBLJPFgcjfX35E31jVHYb6Lc3m9j+jmZLa1yJhH3D2tkKUs7tlnwkb7Cdqz73jwRTxTnN3X/sTnyM3XhOd57QBrQAk0BmSFwJXQhAsNS0DXgKGA==',key_name='tempest-keypair-1536111499',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-2s0r5tw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:23:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=e29684d3-c5fd-4336-abc3-5da416e300e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:33 user nova-compute[74882]: DEBUG os_vif [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap767f656d-f7, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4460422a-860a-443f-88cc-c632681d0e10) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:34 user nova-compute[74882]: INFO os_vif [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7')
Nov 21 14:23:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:34 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:23:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6361eca-fde2-4026-8751-eee311c3764d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:23:34 user nova-compute[74882]: No targets found.
Nov 21 14:23:34 user nova-compute[74882]: iSNS:
Nov 21 14:23:34 user nova-compute[74882]: No targets found.
Nov 21 14:23:34 user nova-compute[74882]: STATIC:
Nov 21 14:23:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:23:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:34 user nova-compute[74882]: FIRMWARE:
Nov 21 14:23:34 user nova-compute[74882]: No targets found.
Nov 21 14:23:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:23:34 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:23:34 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:35 user nova-compute[74882]: WARNING nova.compute.manager [req-5141f0a1-5cd4-424e-bb91-822d7e800ea9 req-c8d8928d-4696-4e07-afe1-93b0739e1bda service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received unexpected event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with vm_state active and task_state rebuilding.
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e0679f-6d62-47d8-8322-45aa892c6799]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2382e4-f67e-42ae-95eb-1314fa872970]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:35 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:35 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:35 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:35 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6c7c70>, {}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Disconnecting from: [] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.149s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== disconnect_volume: return (151ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:23:35 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Deleting instance files /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2_del
Nov 21 14:23:35 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Deletion of /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2_del complete
Nov 21 14:23:35 user nova-compute[74882]: INFO nova.virt.block_device [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Booting with volume d6daff34-cae1-4f15-a582-55aeaead48de at /dev/vdb
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.utils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a78786b-6e9e-4cee-90ea-ed0c952a7a1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.242s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[22062d7b-ea17-41c1-a9c1-fb3528743734]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d0240-9a1a-44a2-9eb7-6d8b46c2e512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87906aa-a8b3-4f05-95b7-43d1cce76e79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:23:35 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:23:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd33bf17-e8c3-45dd-8263-eca1246131a5]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG os_brick.utils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== get_connector_properties: return (362ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:35 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updating existing volume attachment record: b7a4ee60-6177-411b-9ba8-499280eb8b40 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:23:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:23:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Creating image(s)
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk 1073741824" returned: 0 in 0.051s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Cannot resize image /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Ensure instance console log exists: /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Start _get_guest_xml network_info=[{"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e29684d3-c5fd-4336-abc3-5da416e300e2', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6daff34-cae1-4f15-a582-55aeaead48de', 'serial': 'd6daff34-cae1-4f15-a582-55aeaead48de'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'b7a4ee60-6177-411b-9ba8-499280eb8b40', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:23:42 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 21 14:23:42 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'vcpu_model' on Instance uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:42 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:42 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:42 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3996d6d-b9c7-41a0-843b-21380e352592]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:23:42 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a19f873-380d-4fc5-b5a0-3b267bd0ea85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de] added
Nov 21 14:23:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f84806-e157-4537-afea-bc1b8284752b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a163e30-05c1-4d50-9507-79e5427839ef]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQGEHoPB {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQGEHoPB" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e17b4c0-5b55-4458-89db-cf9d637787dc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQGEHoPB'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194fa60-87a4-46fa-89e2-aa5e253dad25]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[489739d6-477a-4c81-a5d1-9733293f4eb1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[76897531-09d7-45f4-8c82-622ead67d902]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]
Nov 21 14:23:42 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05bff9d-96e2-4e2f-996d-7fb5d0c36464]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6af9c-9334-42ab-986d-3331feba4d73]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:42 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aae40a7-7759-4148-b26e-6a0b0b5a26bf]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23235653933646236', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235653933646236', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099597183',display_name='tempest-ServerActionsTestOtherA-server-550921415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099597183',id=15,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8mqZtU9dDhvCuVjxEIBLJPFgcjfX35E31jVHYb6Lc3m9j+jmZLa1yJhH3D2tkKUs7tlnwkb7Cdqz73jwRTxTnN3X/sTnyM3XhOd57QBrQAk0BmSFwJXQhAsNS0DXgKGA==',key_name='tempest-keypair-1536111499',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-2s0r5tw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=e29684d3-c5fd-4336-abc3-5da416e300e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:23:43 user nova-compute[74882]:   <uuid>e29684d3-c5fd-4336-abc3-5da416e300e2</uuid>
Nov 21 14:23:43 user nova-compute[74882]:   <name>instance-0000000f</name>
Nov 21 14:23:43 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:23:43 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:23:43 user nova-compute[74882]:   <metadata>
Nov 21 14:23:43 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:23:43 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:23:43 user nova-compute[74882]:       <nova:name>tempest-ServerActionsTestOtherA-server-550921415</nova:name>
Nov 21 14:23:43 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:23:42</nova:creationTime>
Nov 21 14:23:43 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:23:43 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:23:43 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:23:43 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:23:43 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:23:43 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:23:43 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:23:43 user nova-compute[74882]:       <nova:owner>
Nov 21 14:23:43 user nova-compute[74882]:         <nova:user uuid="d9f06e22265f45beb3760ea3b9338c25">tempest-ServerActionsTestOtherA-538546207-project-member</nova:user>
Nov 21 14:23:43 user nova-compute[74882]:         <nova:project uuid="079d8162d1ea42ddbf31668c8a44cf73">tempest-ServerActionsTestOtherA-538546207</nova:project>
Nov 21 14:23:43 user nova-compute[74882]:       </nova:owner>
Nov 21 14:23:43 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:23:43 user nova-compute[74882]:       <nova:ports>
Nov 21 14:23:43 user nova-compute[74882]:         <nova:port uuid="767f656d-f7c7-4ab0-8727-9c0142c27b7f">
Nov 21 14:23:43 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 21 14:23:43 user nova-compute[74882]:         </nova:port>
Nov 21 14:23:43 user nova-compute[74882]:       </nova:ports>
Nov 21 14:23:43 user nova-compute[74882]:     </nova:instance>
Nov 21 14:23:43 user nova-compute[74882]:   </metadata>
Nov 21 14:23:43 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:23:43 user nova-compute[74882]:     <system>
Nov 21 14:23:43 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:23:43 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:23:43 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:23:43 user nova-compute[74882]:       <entry name="serial">e29684d3-c5fd-4336-abc3-5da416e300e2</entry>
Nov 21 14:23:43 user nova-compute[74882]:       <entry name="uuid">e29684d3-c5fd-4336-abc3-5da416e300e2</entry>
Nov 21 14:23:43 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:23:43 user nova-compute[74882]:     </system>
Nov 21 14:23:43 user nova-compute[74882]:   </sysinfo>
Nov 21 14:23:43 user nova-compute[74882]:   <os>
Nov 21 14:23:43 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:23:43 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:23:43 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:23:43 user nova-compute[74882]:   </os>
Nov 21 14:23:43 user nova-compute[74882]:   <features>
Nov 21 14:23:43 user nova-compute[74882]:     <acpi/>
Nov 21 14:23:43 user nova-compute[74882]:     <apic/>
Nov 21 14:23:43 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:23:43 user nova-compute[74882]:   </features>
Nov 21 14:23:43 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:23:43 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:23:43 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:23:43 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:23:43 user nova-compute[74882]:   </clock>
Nov 21 14:23:43 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:23:43 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:23:43 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:23:43 user nova-compute[74882]:   </cpu>
Nov 21 14:23:43 user nova-compute[74882]:   <devices>
Nov 21 14:23:43 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:23:43 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:23:43 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk"/>
Nov 21 14:23:43 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:23:43 user nova-compute[74882]:     </disk>
Nov 21 14:23:43 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:23:43 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:23:43 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 14:23:43 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:23:43 user nova-compute[74882]:       <serial>d6daff34-cae1-4f15-a582-55aeaead48de</serial>
Nov 21 14:23:43 user nova-compute[74882]:     </disk>
Nov 21 14:23:43 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:23:43 user nova-compute[74882]:       <mac address="fa:16:3e:96:4e:f2"/>
Nov 21 14:23:43 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:23:43 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:23:43 user nova-compute[74882]:       <target dev="tap767f656d-f7"/>
Nov 21 14:23:43 user nova-compute[74882]:     </interface>
Nov 21 14:23:43 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:23:43 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/console.log" append="off"/>
Nov 21 14:23:43 user nova-compute[74882]:     </serial>
Nov 21 14:23:43 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:23:43 user nova-compute[74882]:     <video>
Nov 21 14:23:43 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:23:43 user nova-compute[74882]:     </video>
Nov 21 14:23:43 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:23:43 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:23:43 user nova-compute[74882]:     </rng>
Nov 21 14:23:43 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:23:43 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:23:43 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:23:43 user nova-compute[74882]:     </memballoon>
Nov 21 14:23:43 user nova-compute[74882]:   </devices>
Nov 21 14:23:43 user nova-compute[74882]: </domain>
Nov 21 14:23:43 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099597183',display_name='tempest-ServerActionsTestOtherA-server-550921415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099597183',id=15,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8mqZtU9dDhvCuVjxEIBLJPFgcjfX35E31jVHYb6Lc3m9j+jmZLa1yJhH3D2tkKUs7tlnwkb7Cdqz73jwRTxTnN3X/sTnyM3XhOd57QBrQAk0BmSFwJXQhAsNS0DXgKGA==',key_name='tempest-keypair-1536111499',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:21:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-2s0r5tw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=e29684d3-c5fd-4336-abc3-5da416e300e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG os_vif [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cf6c291-ffe4-5789-87da-45f030373667', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap767f656d-f7, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap767f656d-f7, col_values=(('qos', UUID('68ded77e-3508-4e60-b17e-422193d28d4e')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap767f656d-f7, col_values=(('external_ids', {'iface-id': '767f656d-f7c7-4ab0-8727-9c0142c27b7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:4e:f2', 'vm-uuid': 'e29684d3-c5fd-4336-abc3-5da416e300e2'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:43 user nova-compute[74882]: INFO os_vif [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7')
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:23:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No VIF found with MAC fa:16:3e:96:4e:f2, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:45 user nova-compute[74882]: WARNING nova.compute.manager [req-54ce1b38-a31f-4064-ac32-5f98059c33b3 req-d91fa86d-521e-44ff-864c-ee6c2094e5d8 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received unexpected event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with vm_state active and task_state rebuild_spawning.
Nov 21 14:23:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:23:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance spawned successfully.
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:47 user nova-compute[74882]: WARNING nova.compute.manager [req-17cb4e5f-348c-4b20-ac8a-a84120043e80 req-0406e2cc-3730-4ecc-8305-2aa7397223fc service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received unexpected event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with vm_state active and task_state None.
Nov 21 14:23:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74882) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 21 14:23:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e0adfd32-4d47-4a1e-950c-769c4b0a1186 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.413s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:50 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 is timed out.
Nov 21 14:23:50 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully detached device vdb from instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 from the live domain config.
Nov 21 14:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SsMVroPO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:23:50 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dfb69a-1995-4e86-a97c-f12dfbc1e943]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:23:50 user nova-compute[74882]: No targets found.
Nov 21 14:23:50 user nova-compute[74882]: iSNS:
Nov 21 14:23:50 user nova-compute[74882]: No targets found.
Nov 21 14:23:50 user nova-compute[74882]: STATIC:
Nov 21 14:23:50 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4
Nov 21 14:23:50 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:50 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:50 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:23:50 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:50 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:50 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:23:50 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:23:50 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:23:50 user nova-compute[74882]: FIRMWARE:
Nov 21 14:23:50 user nova-compute[74882]: No targets found.
Nov 21 14:23:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:23:50 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:23:50 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fa7074-797b-4384-b643-81b3efc3e084]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a0f4c3-e9ce-4f87-bf07-d80f57c49c90]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:50 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:50 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 (non-flash)
Nov 21 14:23:50 user nova-compute[74882]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:23:50 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:23:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d94cbbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e268108-cb5a-4f1a-aa2a-7f2ab1791b96]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5397bead-2d2b-417b-9cf2-d5ea9b98d8e9]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5a56f-7d48-4b10-921f-ef64dd91e42e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6608fb2-1d3b-4231-a2da-a1c8bca4e961]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[16460536-a2ae-4852-989d-4cff8184f935]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4090b62c-aa19-4eb4-b164-f8e9d50014cd]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260]
Nov 21 14:23:50 user nova-compute[74882]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4, portal: 172.16.0.220,3260] successful.
Nov 21 14:23:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:949666e2-574c-4f9a-bad7-2074e7b4d4b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4816e9-cd58-42f2-9c02-0c4a9f462fdc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== disconnect_volume: return (315ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:23:51 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ea5202-1f8f-4422-8516-faa9d228a862 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.878s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74882) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:52 user nova-compute[74882]: WARNING nova.compute.manager [req-204faa50-3c59-4316-a177-bc8177c6f871 req-5f13ec8e-f924-4d4a-b39f-6a2e6f903643 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state active and task_state powering-off.
Nov 21 14:23:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance destroyed successfully.
Nov 21 14:23:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e24b8ef7-7610-4907-8c04-6169ffdeff03 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:53 user nova-compute[74882]: INFO nova.compute.manager [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Terminating instance
Nov 21 14:23:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-vif-unplugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] No waiting events found dispatching network-vif-unplugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-ec48b2e9-6012-4d4d-99c5-60e4dacdbc4e req-b1dcd0dd-dfe6-4bd4-b6d9-9ba310e19621 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-vif-unplugged-50684016-dcd4-4d67-86ea-28f525147f47 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:23:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Instance destroyed successfully.
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lazy-loading 'resources' on Instance uuid 1ae17530-7c7f-48bf-a225-11be40152845 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-69618808',display_name='tempest-TestServerVolumeAttachmentScenario-server-69618808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-69618808',id=13,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8C4Sb2Q7RENKXhjMcarLF6PRNiKCyXOcofalm/J3IWw+EcJ81ODybygv9li61aBZl5/kR1a+1vBMHpkuW9chHW1xqux61eLfsPFrgt66iLl0xFD3cu3JsPDbtgRvozmg==',key_name='tempest-keypair-472520468',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:20:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa5a6d1b33924d6c812036141c0edc9c',ramdisk_id='',reservation_id='r-ujjbt6ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-29257918',owner_user_name='tempest-TestServerVolumeAttachmentScenario-29257918-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fa93ca41a2949a0ae5ca758926f613a',uuid=1ae17530-7c7f-48bf-a225-11be40152845,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Converting VIF {"id": "50684016-dcd4-4d67-86ea-28f525147f47", "address": "fa:16:3e:d8:3b:23", "network": {"id": "5d9e28e2-df42-41c9-9d0e-20f8aa058456", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-549411380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa5a6d1b33924d6c812036141c0edc9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50684016-dc", "ovs_interfaceid": "50684016-dcd4-4d67-86ea-28f525147f47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=50684016-dcd4-4d67-86ea-28f525147f47,network=Network(5d9e28e2-df42-41c9-9d0e-20f8aa058456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50684016-dc') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG os_vif [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=50684016-dcd4-4d67-86ea-28f525147f47,network=Network(5d9e28e2-df42-41c9-9d0e-20f8aa058456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50684016-dc') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50684016-dc, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e680326-98e7-49f5-b972-0f69191c9b51) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:54 user nova-compute[74882]: INFO os_vif [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:3b:23,bridge_name='br-int',has_traffic_filtering=True,id=50684016-dcd4-4d67-86ea-28f525147f47,network=Network(5d9e28e2-df42-41c9-9d0e-20f8aa058456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50684016-dc')
Nov 21 14:23:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Deleting instance files /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845_del
Nov 21 14:23:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Deletion of /opt/stack/data/nova/instances/1ae17530-7c7f-48bf-a225-11be40152845_del complete
Nov 21 14:23:54 user nova-compute[74882]: INFO nova.compute.manager [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 21 14:23:54 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:54 user nova-compute[74882]: WARNING nova.compute.manager [req-8c57819c-426d-4861-a7b0-21ab006a89f5 req-31506511-9096-4f39-a27e-6fc7e77ea12f service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state stopped and task_state None.
Nov 21 14:23:55 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:23:55 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Took 0.85 seconds to deallocate network for instance.
Nov 21 14:23:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:55 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:23:55 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:23:55 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:23:55 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:23:55 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:23:55 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.613s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:56 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Deleted allocations for instance 1ae17530-7c7f-48bf-a225-11be40152845
Nov 21 14:23:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e93e0127-1892-48da-b13c-f25b64d43965 tempest-TestServerVolumeAttachmentScenario-29257918 tempest-TestServerVolumeAttachmentScenario-29257918-project-member] Lock "1ae17530-7c7f-48bf-a225-11be40152845" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.570s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Acquiring lock "1ae17530-7c7f-48bf-a225-11be40152845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] Lock "1ae17530-7c7f-48bf-a225-11be40152845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] No waiting events found dispatching network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:23:56 user nova-compute[74882]: WARNING nova.compute.manager [req-e8262ed9-d987-4008-ac38-f2f1ecab42ca req-4aae0c97-88a2-4c4e-8072-d650c9eca543 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received unexpected event network-vif-plugged-50684016-dcd4-4d67-86ea-28f525147f47 for instance with vm_state deleted and task_state None.
Nov 21 14:23:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:23:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-d8ca5ec3-bd48-4469-b02c-e5a38352684d req-c52aff30-90c6-4080-93c0-39c9f9e178b9 service nova] [instance: 1ae17530-7c7f-48bf-a225-11be40152845] Received event network-vif-deleted-50684016-dcd4-4d67-86ea-28f525147f47 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:23:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-changed-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:24:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Refreshing instance network info cache due to event network-changed-a9efa405-53bc-47b6-831c-8bae5302754f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:24:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Acquiring lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:24:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Acquired lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:24:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Refreshing network info cache for port a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:24:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:02 user nova-compute[74882]: DEBUG nova.network.neutron [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updated VIF entry in instance network info cache for port a9efa405-53bc-47b6-831c-8bae5302754f. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:24:02 user nova-compute[74882]: DEBUG nova.network.neutron [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updating instance_info_cache with network_info: [{"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:24:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-da6c7fc5-c8e4-4a09-bcec-70067e4a57bd req-886757e8-db95-4aef-b33e-e14b95934a62 service nova] Releasing lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:24:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:24:02 user nova-compute[74882]: INFO nova.compute.manager [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] instance snapshotting
Nov 21 14:24:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Beginning live snapshot process
Nov 21 14:24:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw6yoecj7/2ba6df6c8f51471b9d76cda85dec77d4.delta 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw6yoecj7/2ba6df6c8f51471b9d76cda85dec77d4.delta 1073741824" returned: 0 in 0.048s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 21 14:24:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] COPY block job progress, current cursor: 15859712 final cursor: 75497472 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'flavor' on Instance uuid 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:04 user nova-compute[74882]: INFO nova.compute.manager [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Attaching volume 553163a7-a13e-4a0b-8e91-75cd4744748a to /dev/vdb
Nov 21 14:24:04 user nova-compute[74882]: DEBUG os_brick.utils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86d7d76-d814-4720-ab92-7aaf82b4b7c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91b45b1-a5da-4688-bee7-763113c243e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1193487-2b91-46c2-9a88-7b6ca28c011e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422d67a-41a9-469c-91f0-4aa4512ca95a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:24:04 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:24:04 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d74a55-bb2c-47bb-b459-bc3cd110c52e]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG os_brick.utils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:24:04 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updating existing volume attachment record: 3ddd4a16-1237-45a4-8a8f-411bba017035 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:24:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:24:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 21 14:24:05 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:24:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw6yoecj7/2ba6df6c8f51471b9d76cda85dec77d4.delta /opt/stack/data/nova/instances/snapshots/tmpw6yoecj7/2ba6df6c8f51471b9d76cda85dec77d4 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw6yoecj7/2ba6df6c8f51471b9d76cda85dec77d4.delta /opt/stack/data/nova/instances/snapshots/tmpw6yoecj7/2ba6df6c8f51471b9d76cda85dec77d4" returned: 0 in 0.376s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Snapshot extracted, beginning image upload
Nov 21 14:24:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:08 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Snapshot image upload complete
Nov 21 14:24:08 user nova-compute[74882]: INFO nova.compute.manager [None req-e9fd84e8-9d0d-450e-af88-51f68c560804 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Took 5.83 seconds to snapshot the instance on the hypervisor.
Nov 21 14:24:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvgJPDeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:24:10 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:24:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:24:10 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:24:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:24:10 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:24:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16af9cd-b1f7-4459-ae6c-43deb9a62233]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:24:10 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0255b2-ae32-47dc-b392-7ae18a631f94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a] added
Nov 21 14:24:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c2f554-1d59-4134-801b-d957cca4ba5a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a0f32c-8bd5-48b1-b3e9-93a5966051e9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvgJPDeo {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvgJPDeo" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9212f649-2695-48a7-a831-b71955152a74]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvgJPDeo'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec83b11-6cd2-4de7-823e-42719c387e7d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e4fa1-c806-4365-b79d-9a7e1b8e84f8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:24:11 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:24:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:24:11 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:24:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a00d1e-1125-41d1-99e2-4b3ca38c8987]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260]
Nov 21 14:24:11 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260] successful.
Nov 21 14:24:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8468e-a409-4c28-aa03-57bd1e3d5f89]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9adeda-a4f8-431e-95f9-ab2c0379ec38]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:24:11 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:24:11 user nova-compute[74882]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a (non-flash)
Nov 21 14:24:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:24:11 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:24:11 user nova-compute[74882]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a (non-flash)
Nov 21 14:24:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0996f9da-6d64-4915-9571-d0a610f1ace0]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid cdeb200f-cb4f-4916-8fef-b35ff231d033 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 9fe53976-492f-40b7-bf48-cfbfc337af0f {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvgJPDeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23039313036393562', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313036393562', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG nova.objects.instance [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'flavor' on Instance uuid 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:24:12 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:24:12 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:24:12 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:24:12 user nova-compute[74882]:   <serial>553163a7-a13e-4a0b-8e91-75cd4744748a</serial>
Nov 21 14:24:12 user nova-compute[74882]: </disk>
Nov 21 14:24:12 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] No VIF found with MAC fa:16:3e:7d:39:26, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-da484487-18bb-41db-8897-01ab5d8af9da tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.109s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "4238ef1f-4d57-472f-b902-33aae507931b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.997s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "4238ef1f-4d57-472f-b902-33aae507931b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:13 user nova-compute[74882]: INFO nova.compute.manager [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Detaching volume 553163a7-a13e-4a0b-8e91-75cd4744748a
Nov 21 14:24:14 user nova-compute[74882]: INFO nova.virt.block_device [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Attempting to driver detach volume 553163a7-a13e-4a0b-8e91-75cd4744748a from mountpoint /dev/vdb
Nov 21 14:24:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Attempting to detach device vdb from instance 4238ef1f-4d57-472f-b902-33aae507931b from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:24:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:24:14 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:24:14 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:24:14 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:24:14 user nova-compute[74882]:   <serial>553163a7-a13e-4a0b-8e91-75cd4744748a</serial>
Nov 21 14:24:14 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:24:14 user nova-compute[74882]: </disk>
Nov 21 14:24:14 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:24:14 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Successfully detached device vdb from instance 4238ef1f-4d57-472f-b902-33aae507931b from the persistent domain config.
Nov 21 14:24:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4238ef1f-4d57-472f-b902-33aae507931b from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:24:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:24:14 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:24:14 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:24:14 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:24:14 user nova-compute[74882]:   <serial>553163a7-a13e-4a0b-8e91-75cd4744748a</serial>
Nov 21 14:24:14 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:24:14 user nova-compute[74882]: </disk>
Nov 21 14:24:14 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:24:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:24:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:24:20 user nova-compute[74882]: INFO nova.compute.claims [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Claim successful on node user
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:24:20 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:24:20 user nova-compute[74882]: DEBUG nova.policy [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:24:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Creating image(s)
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "/opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.219s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk 1073741824" returned: 0 in 0.054s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Cannot resize image /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Ensure instance console log exists: /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Successfully created port: ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Successfully updated port: ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquired lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-changed-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Refreshing instance network info cache due to event network-changed-ac3237ae-45f1-4e33-98c3-521fcbe48dde. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Acquiring lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:24:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Updating instance_info_cache with network_info: [{"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Releasing lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Instance network_info: |[{"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Acquired lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Refreshing network info cache for port ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Start _get_guest_xml network_info=[{"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:24:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:24:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-604809217',display_name='tempest-AttachVolumeNegativeTest-server-604809217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-604809217',id=20,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9FoCMa2qacMZrO6msOrTejPTIdqOfPT3wLUrO03PPV4wxLHauD5Ij6qZ9JF9HMPqxdefkjCKf9UBlbZw8SnpjhUYA9sSwwIK+ESGHFVeAYclwTyns1asQc0+1IS2mdxg==',key_name='tempest-keypair-1826925508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-s03a26gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=a76d5dda-a6c7-4e62-8471-16c8c99344da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:85,bridge_name='br-int',has_traffic_filtering=True,id=ac3237ae-45f1-4e33-98c3-521fcbe48dde,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac3237ae-45') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'pci_devices' on Instance uuid a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:24:23 user nova-compute[74882]:   <uuid>a76d5dda-a6c7-4e62-8471-16c8c99344da</uuid>
Nov 21 14:24:23 user nova-compute[74882]:   <name>instance-00000014</name>
Nov 21 14:24:23 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:24:23 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:24:23 user nova-compute[74882]:   <metadata>
Nov 21 14:24:23 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:24:23 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:24:23 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeNegativeTest-server-604809217</nova:name>
Nov 21 14:24:23 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:24:23</nova:creationTime>
Nov 21 14:24:23 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:24:23 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:24:23 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:24:23 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:24:23 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:24:23 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:24:23 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:24:23 user nova-compute[74882]:       <nova:owner>
Nov 21 14:24:23 user nova-compute[74882]:         <nova:user uuid="d55abe8426b34d10b31ff6b0aefddd37">tempest-AttachVolumeNegativeTest-1777808809-project-member</nova:user>
Nov 21 14:24:23 user nova-compute[74882]:         <nova:project uuid="dadaa9830cd54eb09daee40d952be38f">tempest-AttachVolumeNegativeTest-1777808809</nova:project>
Nov 21 14:24:23 user nova-compute[74882]:       </nova:owner>
Nov 21 14:24:23 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:24:23 user nova-compute[74882]:       <nova:ports>
Nov 21 14:24:23 user nova-compute[74882]:         <nova:port uuid="ac3237ae-45f1-4e33-98c3-521fcbe48dde">
Nov 21 14:24:23 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:24:23 user nova-compute[74882]:         </nova:port>
Nov 21 14:24:23 user nova-compute[74882]:       </nova:ports>
Nov 21 14:24:23 user nova-compute[74882]:     </nova:instance>
Nov 21 14:24:23 user nova-compute[74882]:   </metadata>
Nov 21 14:24:23 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:24:23 user nova-compute[74882]:     <system>
Nov 21 14:24:23 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:24:23 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:24:23 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:24:23 user nova-compute[74882]:       <entry name="serial">a76d5dda-a6c7-4e62-8471-16c8c99344da</entry>
Nov 21 14:24:23 user nova-compute[74882]:       <entry name="uuid">a76d5dda-a6c7-4e62-8471-16c8c99344da</entry>
Nov 21 14:24:23 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:24:23 user nova-compute[74882]:     </system>
Nov 21 14:24:23 user nova-compute[74882]:   </sysinfo>
Nov 21 14:24:23 user nova-compute[74882]:   <os>
Nov 21 14:24:23 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:24:23 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:24:23 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:24:23 user nova-compute[74882]:   </os>
Nov 21 14:24:23 user nova-compute[74882]:   <features>
Nov 21 14:24:23 user nova-compute[74882]:     <acpi/>
Nov 21 14:24:23 user nova-compute[74882]:     <apic/>
Nov 21 14:24:23 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:24:23 user nova-compute[74882]:   </features>
Nov 21 14:24:23 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:24:23 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:24:23 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:24:23 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:24:23 user nova-compute[74882]:   </clock>
Nov 21 14:24:23 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:24:23 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:24:23 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:24:23 user nova-compute[74882]:   </cpu>
Nov 21 14:24:23 user nova-compute[74882]:   <devices>
Nov 21 14:24:23 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:24:23 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:24:23 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk"/>
Nov 21 14:24:23 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:24:23 user nova-compute[74882]:     </disk>
Nov 21 14:24:23 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:24:23 user nova-compute[74882]:       <mac address="fa:16:3e:3f:6d:85"/>
Nov 21 14:24:23 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:24:23 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:24:23 user nova-compute[74882]:       <target dev="tapac3237ae-45"/>
Nov 21 14:24:23 user nova-compute[74882]:     </interface>
Nov 21 14:24:23 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:24:23 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/console.log" append="off"/>
Nov 21 14:24:23 user nova-compute[74882]:     </serial>
Nov 21 14:24:23 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:24:23 user nova-compute[74882]:     <video>
Nov 21 14:24:23 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:24:23 user nova-compute[74882]:     </video>
Nov 21 14:24:23 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:24:23 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:24:23 user nova-compute[74882]:     </rng>
Nov 21 14:24:23 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:24:23 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:24:23 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:24:23 user nova-compute[74882]:     </memballoon>
Nov 21 14:24:23 user nova-compute[74882]:   </devices>
Nov 21 14:24:23 user nova-compute[74882]: </domain>
Nov 21 14:24:23 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-604809217',display_name='tempest-AttachVolumeNegativeTest-server-604809217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-604809217',id=20,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9FoCMa2qacMZrO6msOrTejPTIdqOfPT3wLUrO03PPV4wxLHauD5Ij6qZ9JF9HMPqxdefkjCKf9UBlbZw8SnpjhUYA9sSwwIK+ESGHFVeAYclwTyns1asQc0+1IS2mdxg==',key_name='tempest-keypair-1826925508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-s03a26gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=a76d5dda-a6c7-4e62-8471-16c8c99344da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:85,bridge_name='br-int',has_traffic_filtering=True,id=ac3237ae-45f1-4e33-98c3-521fcbe48dde,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac3237ae-45') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG os_vif [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:85,bridge_name='br-int',has_traffic_filtering=True,id=ac3237ae-45f1-4e33-98c3-521fcbe48dde,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac3237ae-45') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba950e7f-5c11-5a04-a7bd-d7c383585f5e', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac3237ae-45, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac3237ae-45, col_values=(('qos', UUID('fd991962-eb50-46c6-90ac-34fb7b00d821')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac3237ae-45, col_values=(('external_ids', {'iface-id': 'ac3237ae-45f1-4e33-98c3-521fcbe48dde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:6d:85', 'vm-uuid': 'a76d5dda-a6c7-4e62-8471-16c8c99344da'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:23 user nova-compute[74882]: INFO os_vif [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:85,bridge_name='br-int',has_traffic_filtering=True,id=ac3237ae-45f1-4e33-98c3-521fcbe48dde,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac3237ae-45')
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No VIF found with MAC fa:16:3e:3f:6d:85, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Updated VIF entry in instance network info cache for port ac3237ae-45f1-4e33-98c3-521fcbe48dde. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Updating instance_info_cache with network_info: [{"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:24:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2f48cfeb-1af9-4d88-af56-bc84586cf899 req-62997eea-2003-42c8-bf05-ccf285b9294c service nova] Releasing lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:24:24 user nova-compute[74882]: WARNING nova.compute.manager [req-4dabd316-f60e-4638-bc02-44553ed1de6d req-52d7b35d-f129-418d-aff5-173b7fa25ff5 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received unexpected event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with vm_state building and task_state spawning.
Nov 21 14:24:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:24:26 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Instance spawned successfully.
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:24:26 user nova-compute[74882]: INFO nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:24:26 user nova-compute[74882]: WARNING nova.compute.manager [req-664d0ccd-e9d2-4a6d-9851-f4aa2c302b93 req-3abaa9a6-e34b-45fd-98d7-ec7d1196b1db service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received unexpected event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with vm_state building and task_state spawning.
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:27 user nova-compute[74882]: INFO nova.compute.manager [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Took 6.75 seconds to build instance.
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5692578d-e9ce-4f57-8a31-19164f37f5b5 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.847s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:30 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:24:30 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7785MB free_disk=25.431121826171875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e29684d3-c5fd-4336-abc3-5da416e300e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4238ef1f-4d57-472f-b902-33aae507931b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9fe53976-492f-40b7-bf48-cfbfc337af0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance a76d5dda-a6c7-4e62-8471-16c8c99344da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:24:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:24:33 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updating instance_info_cache with network_info: [{"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:34 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4238ef1f-4d57-472f-b902-33aae507931b is timed out.
Nov 21 14:24:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Successfully detached device vdb from instance 4238ef1f-4d57-472f-b902-33aae507931b from the live domain config.
Nov 21 14:24:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvgJPDeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:24:34 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[467d9d8b-45cb-481c-a96b-2c9b4f9d1fe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:24:34 user nova-compute[74882]: No targets found.
Nov 21 14:24:34 user nova-compute[74882]: iSNS:
Nov 21 14:24:34 user nova-compute[74882]: No targets found.
Nov 21 14:24:34 user nova-compute[74882]: STATIC:
Nov 21 14:24:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:24:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:24:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:24:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a
Nov 21 14:24:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:24:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:24:34 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:24:34 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:24:34 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:24:34 user nova-compute[74882]: FIRMWARE:
Nov 21 14:24:34 user nova-compute[74882]: No targets found.
Nov 21 14:24:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:24:34 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:24:34 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d164e8-6ed1-4491-9d52-fdd760dbdb9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[773fef78-a803-4416-a29e-e66ddc77ec12]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:24:34 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:24:34 user nova-compute[74882]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a (non-flash)
Nov 21 14:24:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:24:34 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:24:34 user nova-compute[74882]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a (non-flash)
Nov 21 14:24:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c5540d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[188bc664-6c6c-4f84-86c4-30007b1cfcd8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b5bb10-1942-4282-ab4c-2b4b558f62e8]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae35eb57-2e49-40d4-886d-428e4281de76]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1aa5e1-1f22-44f7-a08d-a9698b94ea95]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c7d96-9728-46fb-8ff9-dfdeae7b294a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e13016-614d-4ac9-b3d1-45197eebbdd5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260]
Nov 21 14:24:34 user nova-compute[74882]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a, portal: 172.16.0.220,3260] successful.
Nov 21 14:24:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:553163a7-a13e-4a0b-8e91-75cd4744748a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90f55e7-1140-433e-810d-f018dfc51453]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] <== disconnect_volume: return (307ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:24:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:24:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:24:35 user nova-compute[74882]: DEBUG nova.objects.instance [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'flavor' on Instance uuid 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:24:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-788d039d-99eb-4d04-a69b-44f0cb8166dc tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.683s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:24:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-changed-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Refreshing instance network info cache due to event network-changed-23e1e132-07a0-4650-9032-872a2dfeafb4. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG nova.network.neutron [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Refreshing network info cache for port 23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG nova.network.neutron [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updated VIF entry in instance network info cache for port 23e1e132-07a0-4650-9032-872a2dfeafb4. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG nova.network.neutron [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:24:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c2204f82-d5b2-4933-b466-a3becfed6db4 req-5df647bb-f308-4760-b3f6-b45cd8c91042 service nova] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:24:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:24:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-changed-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Refreshing instance network info cache due to event network-changed-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:25:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Acquiring lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Acquired lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Refreshing network info cache for port 9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:25:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updated VIF entry in instance network info cache for port 9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:25:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updating instance_info_cache with network_info: [{"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-894d6dc6-66df-4a1a-b684-1943d1fe72e9 req-b36b3b9f-1949-44d8-9161-d184f5c6ebc3 service nova] Releasing lock "refresh_cache-9fe53976-492f-40b7-bf48-cfbfc337af0f" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:01 user nova-compute[74882]: INFO nova.compute.manager [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Rebuilding instance
Nov 21 14:25:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:25:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance destroyed successfully.
Nov 21 14:25:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance destroyed successfully.
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502558027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2116261026',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSSyXlzqE9HWV5D9xNCNaHAa/8qW7iQ87gDowxkTy3UZ/x+eWWMIw/Z9nomrT8J/h8Pa5O/2Fn1eQ1/iYqvGmhapWyfprtgMcYbgJpsjpLdAbOg5GOfsOa4Op/nEyakg==',key_name='tempest-keypair-993669652',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a906ab977ca047e8aacb9c696f166a20',ramdisk_id='',reservation_id='r-0p86wt1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-434641624',owner_user_name='tempest-ServerActionsV293TestJSON-434641624-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff48456740444cf8aee032129cc9f087',uuid=9fe53976-492f-40b7-bf48-cfbfc337af0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converting VIF {"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_vif [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f7ae295-69, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f005722a-9dc2-4a95-a4a6-9d880682542b) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:02 user nova-compute[74882]: INFO os_vif [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69')
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:25:02 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d295a-52a2-408f-856b-a9e1c155dbde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:25:02 user nova-compute[74882]: No targets found.
Nov 21 14:25:02 user nova-compute[74882]: iSNS:
Nov 21 14:25:02 user nova-compute[74882]: No targets found.
Nov 21 14:25:02 user nova-compute[74882]: STATIC:
Nov 21 14:25:02 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:25:02 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:25:02 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:25:02 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:25:02 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:25:02 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:25:02 user nova-compute[74882]: FIRMWARE:
Nov 21 14:25:02 user nova-compute[74882]: No targets found.
Nov 21 14:25:02 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:25:02 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:25:02 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-unplugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-unplugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:02 user nova-compute[74882]: WARNING nova.compute.manager [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received unexpected event network-vif-unplugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with vm_state active and task_state rebuilding.
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:02 user nova-compute[74882]: WARNING nova.compute.manager [req-fbbbea1d-e675-46c4-bb03-b5929b1075f1 req-40c81d08-84d4-46b0-8542-e1978bb69574 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received unexpected event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with vm_state active and task_state rebuilding.
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eefb17-96da-4511-a4b0-7970b29e727a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7266a0-b44d-4c98-9fba-d2fc62768759]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:25:02 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:02 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:25:02 user nova-compute[74882]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:02 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6b0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a1b5a-6b24-46ed-a894-4a9b0a43722a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6323e80-9c11-4a19-b523-3cb312b95fdb]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7e4d0e-b161-4a12-9ac0-ae540b9a245b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b876c9b1-ef45-4308-be8b-8c773c6b3157]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9e67933', '/dev/disk/by-id/scsi-1SCST_BIOe9e67933-09c7d6148116e3ff', '/dev/disk/by-id/scsi-23039633764363134') {{(pid=85964) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a336b-1b64-4411-ac7d-f4e68b3f8d46]: (4, None) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d7a25-8d87-4331-99e9-defb25a84e1c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef7bc4-b1f0-4d83-b7fe-c632f052e469]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]
Nov 21 14:25:02 user nova-compute[74882]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.
Nov 21 14:25:02 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab309ff-868f-4d7b-857d-eb441880d7ed]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] <== disconnect_volume: return (322ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:25:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Deleting instance files /opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f_del
Nov 21 14:25:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Deletion of /opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f_del complete
Nov 21 14:25:02 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9fe53976-492f-40b7-bf48-cfbfc337af0f could not be found.
Nov 21 14:25:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:25:02 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:25:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da0783-8c02-4fcc-b253-09d074dab183]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:25:03 user nova-compute[74882]: No targets found.
Nov 21 14:25:03 user nova-compute[74882]: iSNS:
Nov 21 14:25:03 user nova-compute[74882]: No targets found.
Nov 21 14:25:03 user nova-compute[74882]: STATIC:
Nov 21 14:25:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:25:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:25:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:25:03 user nova-compute[74882]: FIRMWARE:
Nov 21 14:25:03 user nova-compute[74882]: No targets found.
Nov 21 14:25:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:25:03 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:25:03 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[10602226-d101-4cd4-9996-f5ed97146c97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bb9985-9f9c-4b6a-b88b-fa979a02f218]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6b1a20>, {}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Disconnecting from: [] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] <== disconnect_volume: return (70ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Preparing to wait for external event volume-reimaged-3334939e-afed-4b86-8d82-eda72f7b2ff9 {{(pid=74882) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "aa2e856f-1904-4a99-ba39-4e05adbe2360" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:25:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:25:05 user nova-compute[74882]: INFO nova.compute.claims [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Claim successful on node user
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:25:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.policy [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85844a0bfabd4095b647684ad7a1003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26cdaa13ed94137bcb577358a2054dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:25:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Creating image(s)
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "/opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "/opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.207s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk 1073741824" returned: 0 in 0.061s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG nova.network.neutron [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Successfully created port: 983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.223s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Cannot resize image /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Ensure instance console log exists: /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Successfully updated port: 983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "refresh_cache-aa2e856f-1904-4a99-ba39-4e05adbe2360" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquired lock "refresh_cache-aa2e856f-1904-4a99-ba39-4e05adbe2360" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received event network-changed-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Refreshing instance network info cache due to event network-changed-983863ad-bbc2-4827-ac00-16638fbbf0a7. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Acquiring lock "refresh_cache-aa2e856f-1904-4a99-ba39-4e05adbe2360" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Updating instance_info_cache with network_info: [{"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Releasing lock "refresh_cache-aa2e856f-1904-4a99-ba39-4e05adbe2360" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Instance network_info: |[{"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Acquired lock "refresh_cache-aa2e856f-1904-4a99-ba39-4e05adbe2360" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.neutron [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Refreshing network info cache for port 983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Start _get_guest_xml network_info=[{"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:25:08 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:08 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-115556004',display_name='tempest-VolumesAdminNegativeTest-server-115556004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-115556004',id=21,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26cdaa13ed94137bcb577358a2054dc',ramdisk_id='',reservation_id='r-sy56gmcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-564618194',owner_user_name='tempest-VolumesAdminNegativeTest-564618194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:07Z,user_data=None,user_id='85844a0bfabd4095b647684ad7a1003a',uuid=aa2e856f-1904-4a99-ba39-4e05adbe2360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converting VIF {"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:51:b5,bridge_name='br-int',has_traffic_filtering=True,id=983863ad-bbc2-4827-ac00-16638fbbf0a7,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983863ad-bb') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.objects.instance [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'pci_devices' on Instance uuid aa2e856f-1904-4a99-ba39-4e05adbe2360 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:25:08 user nova-compute[74882]:   <uuid>aa2e856f-1904-4a99-ba39-4e05adbe2360</uuid>
Nov 21 14:25:08 user nova-compute[74882]:   <name>instance-00000015</name>
Nov 21 14:25:08 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:25:08 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:25:08 user nova-compute[74882]:   <metadata>
Nov 21 14:25:08 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:25:08 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:25:08 user nova-compute[74882]:       <nova:name>tempest-VolumesAdminNegativeTest-server-115556004</nova:name>
Nov 21 14:25:08 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:25:08</nova:creationTime>
Nov 21 14:25:08 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:25:08 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:25:08 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:25:08 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:25:08 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:25:08 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:25:08 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:25:08 user nova-compute[74882]:       <nova:owner>
Nov 21 14:25:08 user nova-compute[74882]:         <nova:user uuid="85844a0bfabd4095b647684ad7a1003a">tempest-VolumesAdminNegativeTest-564618194-project-member</nova:user>
Nov 21 14:25:08 user nova-compute[74882]:         <nova:project uuid="a26cdaa13ed94137bcb577358a2054dc">tempest-VolumesAdminNegativeTest-564618194</nova:project>
Nov 21 14:25:08 user nova-compute[74882]:       </nova:owner>
Nov 21 14:25:08 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:25:08 user nova-compute[74882]:       <nova:ports>
Nov 21 14:25:08 user nova-compute[74882]:         <nova:port uuid="983863ad-bbc2-4827-ac00-16638fbbf0a7">
Nov 21 14:25:08 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 21 14:25:08 user nova-compute[74882]:         </nova:port>
Nov 21 14:25:08 user nova-compute[74882]:       </nova:ports>
Nov 21 14:25:08 user nova-compute[74882]:     </nova:instance>
Nov 21 14:25:08 user nova-compute[74882]:   </metadata>
Nov 21 14:25:08 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:25:08 user nova-compute[74882]:     <system>
Nov 21 14:25:08 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:25:08 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:25:08 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:25:08 user nova-compute[74882]:       <entry name="serial">aa2e856f-1904-4a99-ba39-4e05adbe2360</entry>
Nov 21 14:25:08 user nova-compute[74882]:       <entry name="uuid">aa2e856f-1904-4a99-ba39-4e05adbe2360</entry>
Nov 21 14:25:08 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:25:08 user nova-compute[74882]:     </system>
Nov 21 14:25:08 user nova-compute[74882]:   </sysinfo>
Nov 21 14:25:08 user nova-compute[74882]:   <os>
Nov 21 14:25:08 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:25:08 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:25:08 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:25:08 user nova-compute[74882]:   </os>
Nov 21 14:25:08 user nova-compute[74882]:   <features>
Nov 21 14:25:08 user nova-compute[74882]:     <acpi/>
Nov 21 14:25:08 user nova-compute[74882]:     <apic/>
Nov 21 14:25:08 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:25:08 user nova-compute[74882]:   </features>
Nov 21 14:25:08 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:25:08 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:25:08 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:25:08 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:25:08 user nova-compute[74882]:   </clock>
Nov 21 14:25:08 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:25:08 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:25:08 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:25:08 user nova-compute[74882]:   </cpu>
Nov 21 14:25:08 user nova-compute[74882]:   <devices>
Nov 21 14:25:08 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:25:08 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:25:08 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk"/>
Nov 21 14:25:08 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:25:08 user nova-compute[74882]:     </disk>
Nov 21 14:25:08 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:25:08 user nova-compute[74882]:       <mac address="fa:16:3e:0a:51:b5"/>
Nov 21 14:25:08 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:08 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:25:08 user nova-compute[74882]:       <target dev="tap983863ad-bb"/>
Nov 21 14:25:08 user nova-compute[74882]:     </interface>
Nov 21 14:25:08 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:25:08 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/console.log" append="off"/>
Nov 21 14:25:08 user nova-compute[74882]:     </serial>
Nov 21 14:25:08 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:25:08 user nova-compute[74882]:     <video>
Nov 21 14:25:08 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:08 user nova-compute[74882]:     </video>
Nov 21 14:25:08 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:25:08 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:25:08 user nova-compute[74882]:     </rng>
Nov 21 14:25:08 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:25:08 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:25:08 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:25:08 user nova-compute[74882]:     </memballoon>
Nov 21 14:25:08 user nova-compute[74882]:   </devices>
Nov 21 14:25:08 user nova-compute[74882]: </domain>
Nov 21 14:25:08 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-115556004',display_name='tempest-VolumesAdminNegativeTest-server-115556004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-115556004',id=21,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a26cdaa13ed94137bcb577358a2054dc',ramdisk_id='',reservation_id='r-sy56gmcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-564618194',owner_user_name='tempest-VolumesAdminNegativeTest-564618194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:07Z,user_data=None,user_id='85844a0bfabd4095b647684ad7a1003a',uuid=aa2e856f-1904-4a99-ba39-4e05adbe2360,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converting VIF {"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:51:b5,bridge_name='br-int',has_traffic_filtering=True,id=983863ad-bbc2-4827-ac00-16638fbbf0a7,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983863ad-bb') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG os_vif [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:51:b5,bridge_name='br-int',has_traffic_filtering=True,id=983863ad-bbc2-4827-ac00-16638fbbf0a7,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983863ad-bb') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1996180-e2be-5031-9c47-9621cdb6b298', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap983863ad-bb, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap983863ad-bb, col_values=(('qos', UUID('79554040-8550-4526-9100-f1f7d69a53a7')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap983863ad-bb, col_values=(('external_ids', {'iface-id': '983863ad-bbc2-4827-ac00-16638fbbf0a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:51:b5', 'vm-uuid': 'aa2e856f-1904-4a99-ba39-4e05adbe2360'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:08 user nova-compute[74882]: INFO os_vif [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:51:b5,bridge_name='br-int',has_traffic_filtering=True,id=983863ad-bbc2-4827-ac00-16638fbbf0a7,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983863ad-bb')
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:25:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] No VIF found with MAC fa:16:3e:0a:51:b5, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:25:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Updated VIF entry in instance network info cache for port 983863ad-bbc2-4827-ac00-16638fbbf0a7. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:25:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Updating instance_info_cache with network_info: [{"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e2f26e29-491b-4254-a407-9f449d81d2bf req-dd9f3ed2-2333-4244-ae76-32437c5ebaf7 service nova] Releasing lock "refresh_cache-aa2e856f-1904-4a99-ba39-4e05adbe2360" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:25:11 user nova-compute[74882]: INFO nova.compute.claims [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Claim successful on node user
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:25:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:25:11 user nova-compute[74882]: INFO nova.virt.block_device [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Booting with blank volume at /dev/vda
Nov 21 14:25:11 user nova-compute[74882]: DEBUG nova.policy [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:25:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:25:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Instance spawned successfully.
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:12 user nova-compute[74882]: INFO nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Successfully created port: 2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:25:12 user nova-compute[74882]: INFO nova.compute.manager [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Took 6.85 seconds to build instance.
Nov 21 14:25:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-077cd055-69c3-4666-bf89-3240d6c854c2 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.959s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Successfully updated port: 2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-changed-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Refreshing instance network info cache due to event network-changed-2af316c0-8063-431b-b1a8-cdb069de9c03. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Acquiring lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received event network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Acquiring lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] No waiting events found dispatching network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:13 user nova-compute[74882]: WARNING nova.compute.manager [req-87181448-9296-4dac-82bb-fa632264e777 req-f3f0806d-71a1-4d4f-babc-6db4904aeef1 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received unexpected event network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance with vm_state active and task_state None.
Nov 21 14:25:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating instance_info_cache with network_info: [{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance network_info: |[{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Acquired lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:13 user nova-compute[74882]: DEBUG nova.network.neutron [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Refreshing network info cache for port 2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:25:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updated VIF entry in instance network info cache for port 2af316c0-8063-431b-b1a8-cdb069de9c03. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:25:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating instance_info_cache with network_info: [{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e9c72bbb-77d7-4fe1-b311-de48ecf8eabe req-b9bdf06c-68d8-4c62-8a16-51e0778b7bea service nova] Releasing lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received event network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Acquiring lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] No waiting events found dispatching network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:15 user nova-compute[74882]: WARNING nova.compute.manager [req-eea2ff71-ce09-49d0-96c6-539b42990cab req-37647dc4-5913-4e94-83d9-f8b2215982b3 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received unexpected event network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance with vm_state active and task_state None.
Nov 21 14:25:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG os_brick.utils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7763bc44-f61f-4b14-b34b-a479cc4fea65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32453e-0ed0-4407-9797-50c6bee2991b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[908b5842-6929-41e9-a914-676a3ae9eee8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d117a49-6e2a-49ee-aaca-f57231c40f4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:25:17 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:25:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cad09a-094b-4879-a994-74a786290bd0]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG os_brick.utils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:25:17 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating existing volume attachment record: e8fa5546-248e-417a-a019-b53c75c81e03 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:25:18 user nova-compute[74882]: INFO nova.compute.claims [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Claim successful on node user
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:25:18 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:25:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.policy [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45ba98964518472c872e959c17ca4f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391e0d9d2d344d06a315a6bbea613404', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:25:19 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Creating image(s)
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "/opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "/opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "/opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.100s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk 1073741824" returned: 0 in 0.053s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Successfully created port: 2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event volume-reimaged-3334939e-afed-4b86-8d82-eda72f7b2ff9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 req-6ff7ebd0-149c-4d35-b850-59953c67accc service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Processing event volume-reimaged-3334939e-afed-4b86-8d82-eda72f7b2ff9 {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 21 14:25:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Cannot resize image /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Ensure instance console log exists: /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:20 user nova-compute[74882]: INFO nova.virt.block_device [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Booting with volume 3334939e-afed-4b86-8d82-eda72f7b2ff9 at /dev/vda
Nov 21 14:25:20 user nova-compute[74882]: DEBUG os_brick.utils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d727b4b8-aa89-44d0-9cfd-f8b6343ef48d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d002bc20-8d72-493d-a5b1-0ed819961b7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb259f0d-f9f0-4c08-9462-2318b679bc86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[52610ed3-3bae-408f-9eba-62ad3dd555ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:25:20 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e99371-677d-442c-9f1a-59581df516fc]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG os_brick.utils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updating existing volume attachment record: 10bc39bf-03fd-43fa-ad93-9e57dd9ac2e0 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Successfully updated port: 2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquired lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-changed-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Refreshing instance network info cache due to event network-changed-2ab935fb-7141-46fd-92c0-9c10ef997044. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Acquiring lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating instance_info_cache with network_info: [{"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Releasing lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Instance network_info: |[{"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Acquired lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.neutron [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Refreshing network info cache for port 2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Start _get_guest_xml network_info=[{"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:25:20 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:20 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2128921177',display_name='tempest-SnapshotDataIntegrityTests-server-2128921177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2128921177',id=23,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG3C2rVjflbNsS9fKtX50ZVRu5n7hGzzD2zwaWwS3KzXKPvBtd1mXi21f4ioMDYvXo98cbLQmUZWrfcw0qGCu34xhX57TDr4UvaDP0layliW8yevW9tj503nkyjdRiFJg==',key_name='tempest-keypair-1440997765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='391e0d9d2d344d06a315a6bbea613404',ramdisk_id='',reservation_id='r-f243hrxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1410147940',owner_user_name='tempest-SnapshotDataIntegrityTests-1410147940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45ba98964518472c872e959c17ca4f1e',uuid=bca6a77c-bc37-4822-b9ed-2c7e16acf0b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Converting VIF {"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:66:55,bridge_name='br-int',has_traffic_filtering=True,id=2ab935fb-7141-46fd-92c0-9c10ef997044,network=Network(36a03207-b935-4278-88e1-4bded651091e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab935fb-71') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.objects.instance [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'pci_devices' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:25:20 user nova-compute[74882]:   <uuid>bca6a77c-bc37-4822-b9ed-2c7e16acf0b9</uuid>
Nov 21 14:25:20 user nova-compute[74882]:   <name>instance-00000017</name>
Nov 21 14:25:20 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:25:20 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:25:20 user nova-compute[74882]:   <metadata>
Nov 21 14:25:20 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:25:20 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:25:20 user nova-compute[74882]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2128921177</nova:name>
Nov 21 14:25:20 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:25:20</nova:creationTime>
Nov 21 14:25:20 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:25:20 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:25:20 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:25:20 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:25:20 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:25:20 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:25:20 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:25:20 user nova-compute[74882]:       <nova:owner>
Nov 21 14:25:20 user nova-compute[74882]:         <nova:user uuid="45ba98964518472c872e959c17ca4f1e">tempest-SnapshotDataIntegrityTests-1410147940-project-member</nova:user>
Nov 21 14:25:20 user nova-compute[74882]:         <nova:project uuid="391e0d9d2d344d06a315a6bbea613404">tempest-SnapshotDataIntegrityTests-1410147940</nova:project>
Nov 21 14:25:20 user nova-compute[74882]:       </nova:owner>
Nov 21 14:25:20 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:25:20 user nova-compute[74882]:       <nova:ports>
Nov 21 14:25:20 user nova-compute[74882]:         <nova:port uuid="2ab935fb-7141-46fd-92c0-9c10ef997044">
Nov 21 14:25:20 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:25:20 user nova-compute[74882]:         </nova:port>
Nov 21 14:25:20 user nova-compute[74882]:       </nova:ports>
Nov 21 14:25:20 user nova-compute[74882]:     </nova:instance>
Nov 21 14:25:20 user nova-compute[74882]:   </metadata>
Nov 21 14:25:20 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:25:20 user nova-compute[74882]:     <system>
Nov 21 14:25:20 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:25:20 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:25:20 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:25:20 user nova-compute[74882]:       <entry name="serial">bca6a77c-bc37-4822-b9ed-2c7e16acf0b9</entry>
Nov 21 14:25:20 user nova-compute[74882]:       <entry name="uuid">bca6a77c-bc37-4822-b9ed-2c7e16acf0b9</entry>
Nov 21 14:25:20 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:25:20 user nova-compute[74882]:     </system>
Nov 21 14:25:20 user nova-compute[74882]:   </sysinfo>
Nov 21 14:25:20 user nova-compute[74882]:   <os>
Nov 21 14:25:20 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:25:20 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:25:20 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:25:20 user nova-compute[74882]:   </os>
Nov 21 14:25:20 user nova-compute[74882]:   <features>
Nov 21 14:25:20 user nova-compute[74882]:     <acpi/>
Nov 21 14:25:20 user nova-compute[74882]:     <apic/>
Nov 21 14:25:20 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:25:20 user nova-compute[74882]:   </features>
Nov 21 14:25:20 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:25:20 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:25:20 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:25:20 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:25:20 user nova-compute[74882]:   </clock>
Nov 21 14:25:20 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:25:20 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:25:20 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:25:20 user nova-compute[74882]:   </cpu>
Nov 21 14:25:20 user nova-compute[74882]:   <devices>
Nov 21 14:25:20 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:25:20 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:25:20 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk"/>
Nov 21 14:25:20 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:25:20 user nova-compute[74882]:     </disk>
Nov 21 14:25:20 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:25:20 user nova-compute[74882]:       <mac address="fa:16:3e:c5:66:55"/>
Nov 21 14:25:20 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:20 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:25:20 user nova-compute[74882]:       <target dev="tap2ab935fb-71"/>
Nov 21 14:25:20 user nova-compute[74882]:     </interface>
Nov 21 14:25:20 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:25:20 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/console.log" append="off"/>
Nov 21 14:25:20 user nova-compute[74882]:     </serial>
Nov 21 14:25:20 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:25:20 user nova-compute[74882]:     <video>
Nov 21 14:25:20 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:20 user nova-compute[74882]:     </video>
Nov 21 14:25:20 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:25:20 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:25:20 user nova-compute[74882]:     </rng>
Nov 21 14:25:20 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:25:20 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:25:20 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:25:20 user nova-compute[74882]:     </memballoon>
Nov 21 14:25:20 user nova-compute[74882]:   </devices>
Nov 21 14:25:20 user nova-compute[74882]: </domain>
Nov 21 14:25:20 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2128921177',display_name='tempest-SnapshotDataIntegrityTests-server-2128921177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2128921177',id=23,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG3C2rVjflbNsS9fKtX50ZVRu5n7hGzzD2zwaWwS3KzXKPvBtd1mXi21f4ioMDYvXo98cbLQmUZWrfcw0qGCu34xhX57TDr4UvaDP0layliW8yevW9tj503nkyjdRiFJg==',key_name='tempest-keypair-1440997765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='391e0d9d2d344d06a315a6bbea613404',ramdisk_id='',reservation_id='r-f243hrxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1410147940',owner_user_name='tempest-SnapshotDataIntegrityTests-1410147940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45ba98964518472c872e959c17ca4f1e',uuid=bca6a77c-bc37-4822-b9ed-2c7e16acf0b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Converting VIF {"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:66:55,bridge_name='br-int',has_traffic_filtering=True,id=2ab935fb-7141-46fd-92c0-9c10ef997044,network=Network(36a03207-b935-4278-88e1-4bded651091e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab935fb-71') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG os_vif [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:66:55,bridge_name='br-int',has_traffic_filtering=True,id=2ab935fb-7141-46fd-92c0-9c10ef997044,network=Network(36a03207-b935-4278-88e1-4bded651091e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab935fb-71') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b440cc67-d80e-5213-a76e-be1a958af100', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ab935fb-71, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ab935fb-71, col_values=(('qos', UUID('4cfb880b-6dc9-49f4-a3fb-2d67ce1b52d3')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ab935fb-71, col_values=(('external_ids', {'iface-id': '2ab935fb-7141-46fd-92c0-9c10ef997044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:66:55', 'vm-uuid': 'bca6a77c-bc37-4822-b9ed-2c7e16acf0b9'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:20 user nova-compute[74882]: INFO os_vif [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:66:55,bridge_name='br-int',has_traffic_filtering=True,id=2ab935fb-7141-46fd-92c0-9c10ef997044,network=Network(36a03207-b935-4278-88e1-4bded651091e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab935fb-71')
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:25:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No VIF found with MAC fa:16:3e:c5:66:55, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:25:21 user nova-compute[74882]: DEBUG nova.network.neutron [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updated VIF entry in instance network info cache for port 2ab935fb-7141-46fd-92c0-9c10ef997044. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:25:21 user nova-compute[74882]: DEBUG nova.network.neutron [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating instance_info_cache with network_info: [{"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6e21562d-2cc5-404a-9ab9-b7a9dcfbaf41 req-479162ed-a019-4bd2-8712-d4f84c5f3ba2 service nova] Releasing lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] No waiting events found dispatching network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:22 user nova-compute[74882]: WARNING nova.compute.manager [req-b356212d-b961-4144-a1cd-dcdb655000fe req-64f361f2-797f-4187-b180-46c29765d4fd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received unexpected event network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 for instance with vm_state building and task_state spawning.
Nov 21 14:25:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:25:24 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Creating image(s)
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Ensure instance console log exists: /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Start _get_guest_xml network_info=[{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLoreNDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5dddf05e-1c0b-42a2-8fd0-22ce4a539d44', 'attached_at': '', 'detached_at': '', 'volume_id': 'cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'serial': 'cea0a613-7c3f-40c3-8a2a-fe3d8871e750'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'e8fa5546-248e-417a-a019-b53c75c81e03', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:25:24 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:24 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLoreNDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:25:24 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:25:24 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:25:24 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbc8bc-1ac5-4e0b-9a03-436b7575b29d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:25:24 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e0307-58e1-48be-8a75-766cf3c9cbc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750] added
Nov 21 14:25:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd74b1b8-b02e-44eb-887c-4ad24610e05e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a7d25-fc31-4e84-a7a8-9fe687a57cb9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLoreNDm {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLoreNDm" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2056128c-4fae-4d5f-b46e-4ecd97e24149]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLoreNDm'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b9860a-d2cd-428a-a0f0-c769c7773429]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b964c3d-b4ab-4829-864a-b6644025f6e4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[019d6ec3-321f-437b-a083-285b6419b739]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260]
Nov 21 14:25:24 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260] successful.
Nov 21 14:25:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[390c1fd8-6d2e-4992-a92a-596ce0331467]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca059fd7-ec00-4084-9fa7-b000e4e39afe]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:24 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:25:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:24 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:25:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e545f0e2-817e-45a8-be34-fcaee9b618d7]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLoreNDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:25:24 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Instance spawned successfully.
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] No waiting events found dispatching network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:24 user nova-compute[74882]: WARNING nova.compute.manager [req-410bc889-7a7c-4195-9b18-1b4d57faed93 req-371d6527-c05f-4a9d-8344-bdb4c2c0bba0 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received unexpected event network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 for instance with vm_state building and task_state spawning.
Nov 21 14:25:24 user nova-compute[74882]: INFO nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 21 14:25:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:25:24 user nova-compute[74882]: INFO nova.compute.manager [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Took 6.60 seconds to build instance.
Nov 21 14:25:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55a2afe0-a481-43c9-bee0-e568d62a9f3b tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.771s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23066656461643831', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066656461643831', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677425991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677425991',id=22,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-jwp56qp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:12Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=5dddf05e-1c0b-42a2-8fd0-22ce4a539d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:25:25 user nova-compute[74882]:   <uuid>5dddf05e-1c0b-42a2-8fd0-22ce4a539d44</uuid>
Nov 21 14:25:25 user nova-compute[74882]:   <name>instance-00000016</name>
Nov 21 14:25:25 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:25:25 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:25:25 user nova-compute[74882]:   <metadata>
Nov 21 14:25:25 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:25:25 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:25:25 user nova-compute[74882]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-677425991</nova:name>
Nov 21 14:25:25 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:25:24</nova:creationTime>
Nov 21 14:25:25 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:25:25 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:25:25 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:25:25 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:25:25 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:25:25 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:25:25 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:25:25 user nova-compute[74882]:       <nova:owner>
Nov 21 14:25:25 user nova-compute[74882]:         <nova:user uuid="7635b3029cf14950a1978282d06bc8f3">tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member</nova:user>
Nov 21 14:25:25 user nova-compute[74882]:         <nova:project uuid="96e5113ec65d46c4b8859c4658433b02">tempest-ServerBootFromVolumeStableRescueTest-1086017756</nova:project>
Nov 21 14:25:25 user nova-compute[74882]:       </nova:owner>
Nov 21 14:25:25 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:25:25 user nova-compute[74882]:       <nova:ports>
Nov 21 14:25:25 user nova-compute[74882]:         <nova:port uuid="2af316c0-8063-431b-b1a8-cdb069de9c03">
Nov 21 14:25:25 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 21 14:25:25 user nova-compute[74882]:         </nova:port>
Nov 21 14:25:25 user nova-compute[74882]:       </nova:ports>
Nov 21 14:25:25 user nova-compute[74882]:     </nova:instance>
Nov 21 14:25:25 user nova-compute[74882]:   </metadata>
Nov 21 14:25:25 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:25:25 user nova-compute[74882]:     <system>
Nov 21 14:25:25 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:25:25 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:25:25 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:25:25 user nova-compute[74882]:       <entry name="serial">5dddf05e-1c0b-42a2-8fd0-22ce4a539d44</entry>
Nov 21 14:25:25 user nova-compute[74882]:       <entry name="uuid">5dddf05e-1c0b-42a2-8fd0-22ce4a539d44</entry>
Nov 21 14:25:25 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:25:25 user nova-compute[74882]:     </system>
Nov 21 14:25:25 user nova-compute[74882]:   </sysinfo>
Nov 21 14:25:25 user nova-compute[74882]:   <os>
Nov 21 14:25:25 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:25:25 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:25:25 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:25:25 user nova-compute[74882]:   </os>
Nov 21 14:25:25 user nova-compute[74882]:   <features>
Nov 21 14:25:25 user nova-compute[74882]:     <acpi/>
Nov 21 14:25:25 user nova-compute[74882]:     <apic/>
Nov 21 14:25:25 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:25:25 user nova-compute[74882]:   </features>
Nov 21 14:25:25 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:25:25 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:25:25 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:25:25 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:25:25 user nova-compute[74882]:   </clock>
Nov 21 14:25:25 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:25:25 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:25:25 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:25:25 user nova-compute[74882]:   </cpu>
Nov 21 14:25:25 user nova-compute[74882]:   <devices>
Nov 21 14:25:25 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:25:25 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:25:25 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:25:25 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:25:25 user nova-compute[74882]:       <serial>cea0a613-7c3f-40c3-8a2a-fe3d8871e750</serial>
Nov 21 14:25:25 user nova-compute[74882]:     </disk>
Nov 21 14:25:25 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:25:25 user nova-compute[74882]:       <mac address="fa:16:3e:86:06:ac"/>
Nov 21 14:25:25 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:25 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:25:25 user nova-compute[74882]:       <target dev="tap2af316c0-80"/>
Nov 21 14:25:25 user nova-compute[74882]:     </interface>
Nov 21 14:25:25 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:25:25 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/console.log" append="off"/>
Nov 21 14:25:25 user nova-compute[74882]:     </serial>
Nov 21 14:25:25 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:25:25 user nova-compute[74882]:     <video>
Nov 21 14:25:25 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:25 user nova-compute[74882]:     </video>
Nov 21 14:25:25 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:25:25 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:25:25 user nova-compute[74882]:     </rng>
Nov 21 14:25:25 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:25:25 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:25:25 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:25:25 user nova-compute[74882]:     </memballoon>
Nov 21 14:25:25 user nova-compute[74882]:   </devices>
Nov 21 14:25:25 user nova-compute[74882]: </domain>
Nov 21 14:25:25 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677425991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677425991',id=22,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-jwp56qp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:12Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=5dddf05e-1c0b-42a2-8fd0-22ce4a539d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG os_vif [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c93d962e-1bce-5b52-bd6c-a3c5e6ebeb9a', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2af316c0-80, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2af316c0-80, col_values=(('qos', UUID('b4637086-ea3c-4d5d-8cc5-4ffbc19b87a2')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2af316c0-80, col_values=(('external_ids', {'iface-id': '2af316c0-8063-431b-b1a8-cdb069de9c03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:06:ac', 'vm-uuid': '5dddf05e-1c0b-42a2-8fd0-22ce4a539d44'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:25 user nova-compute[74882]: INFO os_vif [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80')
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:25:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No VIF found with MAC fa:16:3e:86:06:ac, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:25:26 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Creating image(s)
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Ensure instance console log exists: /opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Start _get_guest_xml network_info=[{"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9fe53976-492f-40b7-bf48-cfbfc337af0f', 'attached_at': '', 'detached_at': '', 'volume_id': '3334939e-afed-4b86-8d82-eda72f7b2ff9', 'serial': '3334939e-afed-4b86-8d82-eda72f7b2ff9'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '10bc39bf-03fd-43fa-ad93-9e57dd9ac2e0', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:25:26 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 21 14:25:26 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fe53976-492f-40b7-bf48-cfbfc337af0f {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:25:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:25:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:25:27 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b37f4-ec50-4c86-b07d-eca629fafc91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:25:27 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c428f847-f552-4b57-a4f3-944901e072cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9] added
Nov 21 14:25:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf3e5a1-76bf-41a4-835b-305ec7f14190]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ec8aa5-fbe4-4a48-b758-e61683f9bfa9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvMlNsDL {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvMlNsDL" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9200ae9f-3559-4854-bafc-65c4fd1dd17c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvMlNsDL'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4e0fcb-1568-4ffd-b946-bffc2a25e0f8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ee9bfa-2030-4d6b-b6d8-ebfc745e624d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:27 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:25:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:27 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:25:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ee9df-d056-40ce-8f89-0a4344a26da9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]
Nov 21 14:25:27 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.
Nov 21 14:25:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b015c8b6-9e90-4477-a21c-e3046f8cb220]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c393e73-c2ba-44b8-89da-e31cdc769a18]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:27 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:25:27 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:25:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:25:27 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:25:27 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:25:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1063af6c-180f-402c-a353-3b24d9517df0]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:27 user nova-compute[74882]: WARNING nova.compute.manager [req-65acb37c-be1f-47c4-876e-bfd661830d85 req-62225355-cfc3-4873-ad5d-ae89e6debc8c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state building and task_state spawning.
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23039633764363134', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039633764363134', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502558027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2116261026',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSSyXlzqE9HWV5D9xNCNaHAa/8qW7iQ87gDowxkTy3UZ/x+eWWMIw/Z9nomrT8J/h8Pa5O/2Fn1eQ1/iYqvGmhapWyfprtgMcYbgJpsjpLdAbOg5GOfsOa4Op/nEyakg==',key_name='tempest-keypair-993669652',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a906ab977ca047e8aacb9c696f166a20',ramdisk_id='',reservation_id='r-0p86wt1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-434641624',owner_user_name='tempest-ServerActionsV293TestJSON-434641624-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff48456740444cf8aee032129cc9f087',uuid=9fe53976-492f-40b7-bf48-cfbfc337af0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converting VIF {"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:25:28 user nova-compute[74882]:   <uuid>9fe53976-492f-40b7-bf48-cfbfc337af0f</uuid>
Nov 21 14:25:28 user nova-compute[74882]:   <name>instance-00000013</name>
Nov 21 14:25:28 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:25:28 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:25:28 user nova-compute[74882]:   <metadata>
Nov 21 14:25:28 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:25:28 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:25:28 user nova-compute[74882]:       <nova:name>tempest-ServerActionsV293TestJSON-server-502558027</nova:name>
Nov 21 14:25:28 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:25:26</nova:creationTime>
Nov 21 14:25:28 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:25:28 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:25:28 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:25:28 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:25:28 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:25:28 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:25:28 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:25:28 user nova-compute[74882]:       <nova:owner>
Nov 21 14:25:28 user nova-compute[74882]:         <nova:user uuid="ff48456740444cf8aee032129cc9f087">tempest-ServerActionsV293TestJSON-434641624-project-member</nova:user>
Nov 21 14:25:28 user nova-compute[74882]:         <nova:project uuid="a906ab977ca047e8aacb9c696f166a20">tempest-ServerActionsV293TestJSON-434641624</nova:project>
Nov 21 14:25:28 user nova-compute[74882]:       </nova:owner>
Nov 21 14:25:28 user nova-compute[74882]:       <nova:ports>
Nov 21 14:25:28 user nova-compute[74882]:         <nova:port uuid="9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1">
Nov 21 14:25:28 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 21 14:25:28 user nova-compute[74882]:         </nova:port>
Nov 21 14:25:28 user nova-compute[74882]:       </nova:ports>
Nov 21 14:25:28 user nova-compute[74882]:     </nova:instance>
Nov 21 14:25:28 user nova-compute[74882]:   </metadata>
Nov 21 14:25:28 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:25:28 user nova-compute[74882]:     <system>
Nov 21 14:25:28 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:25:28 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:25:28 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:25:28 user nova-compute[74882]:       <entry name="serial">9fe53976-492f-40b7-bf48-cfbfc337af0f</entry>
Nov 21 14:25:28 user nova-compute[74882]:       <entry name="uuid">9fe53976-492f-40b7-bf48-cfbfc337af0f</entry>
Nov 21 14:25:28 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:25:28 user nova-compute[74882]:     </system>
Nov 21 14:25:28 user nova-compute[74882]:   </sysinfo>
Nov 21 14:25:28 user nova-compute[74882]:   <os>
Nov 21 14:25:28 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:25:28 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:25:28 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:25:28 user nova-compute[74882]:   </os>
Nov 21 14:25:28 user nova-compute[74882]:   <features>
Nov 21 14:25:28 user nova-compute[74882]:     <acpi/>
Nov 21 14:25:28 user nova-compute[74882]:     <apic/>
Nov 21 14:25:28 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:25:28 user nova-compute[74882]:   </features>
Nov 21 14:25:28 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:25:28 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:25:28 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:25:28 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:25:28 user nova-compute[74882]:   </clock>
Nov 21 14:25:28 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:25:28 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:25:28 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:25:28 user nova-compute[74882]:   </cpu>
Nov 21 14:25:28 user nova-compute[74882]:   <devices>
Nov 21 14:25:28 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:25:28 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:25:28 user nova-compute[74882]:       <source dev="/dev/sdd"/>
Nov 21 14:25:28 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:25:28 user nova-compute[74882]:       <serial>3334939e-afed-4b86-8d82-eda72f7b2ff9</serial>
Nov 21 14:25:28 user nova-compute[74882]:     </disk>
Nov 21 14:25:28 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:25:28 user nova-compute[74882]:       <mac address="fa:16:3e:53:e9:6f"/>
Nov 21 14:25:28 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:28 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:25:28 user nova-compute[74882]:       <target dev="tap9f7ae295-69"/>
Nov 21 14:25:28 user nova-compute[74882]:     </interface>
Nov 21 14:25:28 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:25:28 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f/console.log" append="off"/>
Nov 21 14:25:28 user nova-compute[74882]:     </serial>
Nov 21 14:25:28 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:25:28 user nova-compute[74882]:     <video>
Nov 21 14:25:28 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:28 user nova-compute[74882]:     </video>
Nov 21 14:25:28 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:25:28 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:25:28 user nova-compute[74882]:     </rng>
Nov 21 14:25:28 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:25:28 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:25:28 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:25:28 user nova-compute[74882]:     </memballoon>
Nov 21 14:25:28 user nova-compute[74882]:   </devices>
Nov 21 14:25:28 user nova-compute[74882]: </domain>
Nov 21 14:25:28 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502558027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2116261026',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSSyXlzqE9HWV5D9xNCNaHAa/8qW7iQ87gDowxkTy3UZ/x+eWWMIw/Z9nomrT8J/h8Pa5O/2Fn1eQ1/iYqvGmhapWyfprtgMcYbgJpsjpLdAbOg5GOfsOa4Op/nEyakg==',key_name='tempest-keypair-993669652',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a906ab977ca047e8aacb9c696f166a20',ramdisk_id='',reservation_id='r-0p86wt1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-434641624',owner_user_name='tempest-ServerActionsV293TestJSON-434641624-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff48456740444cf8aee032129cc9f087',uuid=9fe53976-492f-40b7-bf48-cfbfc337af0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converting VIF {"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG os_vif [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43e14c8b-60f6-537b-bf79-8b85bfdcceec', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f7ae295-69, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f7ae295-69, col_values=(('qos', UUID('a1a6b4ea-49a3-4329-a8fb-fe89a77e0b69')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f7ae295-69, col_values=(('external_ids', {'iface-id': '9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:e9:6f', 'vm-uuid': '9fe53976-492f-40b7-bf48-cfbfc337af0f'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:28 user nova-compute[74882]: INFO os_vif [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69')
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] No VIF found with MAC fa:16:3e:53:e9:6f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:25:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance spawned successfully.
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:29 user nova-compute[74882]: WARNING nova.compute.manager [req-775cc563-0aa2-4c25-8dd2-de3415338ef5 req-48175541-c49a-45d2-8905-4d5b945e80bd service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state building and task_state spawning.
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:29 user nova-compute[74882]: INFO nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 21 14:25:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:25:29 user nova-compute[74882]: INFO nova.compute.manager [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Took 18.70 seconds to build instance.
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e63e6a19-dc42-4231-8c7d-2d15cfa76746 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.808s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:30 user nova-compute[74882]: WARNING nova.compute.manager [req-598b068b-6409-428c-a9f7-1508e37c412b req-2f2c349c-3d56-47b7-875e-7b54b09de646 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received unexpected event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with vm_state active and task_state rebuild_spawning.
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:32 user nova-compute[74882]: WARNING nova.compute.manager [req-8799641c-6b51-40f8-bc9a-ad9413fea0f1 req-4067a328-7556-40b7-8fd8-4a24d7a41579 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received unexpected event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with vm_state active and task_state rebuild_spawning.
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:25:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7724MB free_disk=25.362689971923828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:32 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance spawned successfully.
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e29684d3-c5fd-4336-abc3-5da416e300e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4238ef1f-4d57-472f-b902-33aae507931b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9fe53976-492f-40b7-bf48-cfbfc337af0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance a76d5dda-a6c7-4e62-8471-16c8c99344da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance aa2e856f-1904-4a99-ba39-4e05adbe2360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.352s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74882) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 21 14:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4279f4e7-c1d7-4098-b4c0-58cdf4925a26 tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:35 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:25:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquired lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'info_cache' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.base [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Releasing lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:25:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance destroyed successfully.
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'resources' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.base [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG os_vif [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf39421d4-14, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e66c97d6-b4be-46c9-a678-327a04f93dd0) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:43 user nova-compute[74882]: INFO os_vif [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14')
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Start _get_guest_xml network_info=[{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'numa_topology' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.base [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:25:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.base [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'pci_devices' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.objects.base [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:25:43 user nova-compute[74882]:   <uuid>7892830a-13fc-48a2-bfd3-29a96b2a9113</uuid>
Nov 21 14:25:43 user nova-compute[74882]:   <name>instance-00000005</name>
Nov 21 14:25:43 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:25:43 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:25:43 user nova-compute[74882]:   <metadata>
Nov 21 14:25:43 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:25:43 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:25:43 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeTestJSON-server-70492316</nova:name>
Nov 21 14:25:43 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:25:43</nova:creationTime>
Nov 21 14:25:43 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:25:43 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:25:43 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:25:43 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:25:43 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:25:43 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:25:43 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:25:43 user nova-compute[74882]:       <nova:owner>
Nov 21 14:25:43 user nova-compute[74882]:         <nova:user uuid="c0cb90d4bdf74f9390124833ea8331bd">tempest-AttachVolumeTestJSON-1610644153-project-member</nova:user>
Nov 21 14:25:43 user nova-compute[74882]:         <nova:project uuid="894802e2e3d044199467be931dd8e036">tempest-AttachVolumeTestJSON-1610644153</nova:project>
Nov 21 14:25:43 user nova-compute[74882]:       </nova:owner>
Nov 21 14:25:43 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:25:43 user nova-compute[74882]:       <nova:ports>
Nov 21 14:25:43 user nova-compute[74882]:         <nova:port uuid="f39421d4-14c9-470b-9aab-7c4b25deccd2">
Nov 21 14:25:43 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 21 14:25:43 user nova-compute[74882]:         </nova:port>
Nov 21 14:25:43 user nova-compute[74882]:       </nova:ports>
Nov 21 14:25:43 user nova-compute[74882]:     </nova:instance>
Nov 21 14:25:43 user nova-compute[74882]:   </metadata>
Nov 21 14:25:43 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:25:43 user nova-compute[74882]:     <system>
Nov 21 14:25:43 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:25:43 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:25:43 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:25:43 user nova-compute[74882]:       <entry name="serial">7892830a-13fc-48a2-bfd3-29a96b2a9113</entry>
Nov 21 14:25:43 user nova-compute[74882]:       <entry name="uuid">7892830a-13fc-48a2-bfd3-29a96b2a9113</entry>
Nov 21 14:25:43 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:25:43 user nova-compute[74882]:     </system>
Nov 21 14:25:43 user nova-compute[74882]:   </sysinfo>
Nov 21 14:25:43 user nova-compute[74882]:   <os>
Nov 21 14:25:43 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:25:43 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:25:43 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:25:43 user nova-compute[74882]:   </os>
Nov 21 14:25:43 user nova-compute[74882]:   <features>
Nov 21 14:25:43 user nova-compute[74882]:     <acpi/>
Nov 21 14:25:43 user nova-compute[74882]:     <apic/>
Nov 21 14:25:43 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:25:43 user nova-compute[74882]:   </features>
Nov 21 14:25:43 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:25:43 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:25:43 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:25:43 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:25:43 user nova-compute[74882]:   </clock>
Nov 21 14:25:43 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:25:43 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:25:43 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:25:43 user nova-compute[74882]:   </cpu>
Nov 21 14:25:43 user nova-compute[74882]:   <devices>
Nov 21 14:25:43 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:25:43 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:25:43 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk"/>
Nov 21 14:25:43 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:25:43 user nova-compute[74882]:     </disk>
Nov 21 14:25:43 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:25:43 user nova-compute[74882]:       <mac address="fa:16:3e:5c:a6:7f"/>
Nov 21 14:25:43 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:43 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:25:43 user nova-compute[74882]:       <target dev="tapf39421d4-14"/>
Nov 21 14:25:43 user nova-compute[74882]:     </interface>
Nov 21 14:25:43 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:25:43 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/console.log" append="off"/>
Nov 21 14:25:43 user nova-compute[74882]:     </serial>
Nov 21 14:25:43 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:25:43 user nova-compute[74882]:     <video>
Nov 21 14:25:43 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:25:43 user nova-compute[74882]:     </video>
Nov 21 14:25:43 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:25:43 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:25:43 user nova-compute[74882]:     </rng>
Nov 21 14:25:43 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:25:43 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:25:43 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:25:43 user nova-compute[74882]:     </memballoon>
Nov 21 14:25:43 user nova-compute[74882]:   </devices>
Nov 21 14:25:43 user nova-compute[74882]: </domain>
Nov 21 14:25:43 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.objects.base [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Cannot resize image /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'migration_context' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.objects.base [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Object Instance<7892830a-13fc-48a2-bfd3-29a96b2a9113> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG os_vif [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19d5e82a-b4b2-51a0-a994-4278e9a69e26', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf39421d4-14, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf39421d4-14, col_values=(('qos', UUID('4d9c2e9c-5193-4b59-85ff-10e8307cfb14')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf39421d4-14, col_values=(('external_ids', {'iface-id': 'f39421d4-14c9-470b-9aab-7c4b25deccd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:a6:7f', 'vm-uuid': '7892830a-13fc-48a2-bfd3-29a96b2a9113'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:25:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:44 user nova-compute[74882]: INFO os_vif [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14')
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:46 user nova-compute[74882]: WARNING nova.compute.manager [req-3480f955-108d-45ac-93aa-b132eb256cdb req-50cea90a-a49f-44f5-87dd-bd046665a3f5 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state stopped and task_state powering-on.
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:25:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance rebooted successfully.
Nov 21 14:25:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5208af04-c44c-4f9d-8d26-1dcdf33d6b99 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:25:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:25:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:25:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:25:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:25:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:25:48 user nova-compute[74882]: WARNING nova.compute.manager [req-5ffeed2a-0673-4b8f-a938-df446ef3947c req-7ae3b1a6-ed68-4fda-89c6-e013778e7c37 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state active and task_state None.
Nov 21 14:25:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:25:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-changed-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Refreshing instance network info cache due to event network-changed-ac3237ae-45f1-4e33-98c3-521fcbe48dde. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:26:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Acquiring lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:26:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Acquired lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:26:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Refreshing network info cache for port ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:26:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Updated VIF entry in instance network info cache for port ac3237ae-45f1-4e33-98c3-521fcbe48dde. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:26:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Updating instance_info_cache with network_info: [{"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:26:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9330d1-a537-4603-af43-d99523b4c0c7 req-39f4a737-0c67-4385-bff8-52f4429e7e46 service nova] Releasing lock "refresh_cache-a76d5dda-a6c7-4e62-8471-16c8c99344da" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG nova.objects.instance [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:14 user nova-compute[74882]: INFO nova.compute.manager [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Attaching volume eecc96a4-4c9d-4267-8b5f-446fda932a64 to /dev/vdb
Nov 21 14:26:14 user nova-compute[74882]: DEBUG os_brick.utils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d6a5c-b058-4cfd-b955-6f70989c6be5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a56b79d-7463-48d8-80a5-f42b56c764b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e197824f-ff6f-4035-8334-176d94e56899]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[720817e4-8cc4-42a0-a9d6-e3d39d5fbd94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:26:15 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:26:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e0b930-8bb4-4ca8-8dce-08535340a479]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:15 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Updating existing volume attachment record: b53334e2-8b50-4639-b0cb-051a707d7ee0 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:26:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:16 user nova-compute[74882]: INFO nova.compute.manager [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Terminating instance
Nov 21 14:26:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received event network-vif-unplugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] No waiting events found dispatching network-vif-unplugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-337c06fc-4cff-4bc9-ab91-12623e7d6f6c req-0be304be-8030-4c3f-9ffb-94157c757285 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received event network-vif-unplugged-f173e853-6ea8-452e-8db2-e8a975c2f5df for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Instance destroyed successfully.
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.objects.instance [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lazy-loading 'resources' on Instance uuid ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-716976770',display_name='tempest-ServersNegativeTestJSON-server-716976770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-716976770',id=2,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8612dc478d4a40babe74b1fbf45eac93',ramdisk_id='',reservation_id='r-01ejk0kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1655313892',owner_user_name='tempest-ServersNegativeTestJSON-1655313892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:17:43Z,user_data=None,user_id='ec7d58eda515420f8b815338d2efd377',uuid=ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converting VIF {"id": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "address": "fa:16:3e:e8:d1:6f", "network": {"id": "a9ab1c2c-271a-4606-b53d-a309e4992de9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1720823224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8612dc478d4a40babe74b1fbf45eac93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf173e853-6e", "ovs_interfaceid": "f173e853-6ea8-452e-8db2-e8a975c2f5df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:d1:6f,bridge_name='br-int',has_traffic_filtering=True,id=f173e853-6ea8-452e-8db2-e8a975c2f5df,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf173e853-6e') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG os_vif [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:d1:6f,bridge_name='br-int',has_traffic_filtering=True,id=f173e853-6ea8-452e-8db2-e8a975c2f5df,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf173e853-6e') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf173e853-6e, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7e75be8-d64a-4447-9f6e-415fc2651816) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:17 user nova-compute[74882]: INFO os_vif [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:d1:6f,bridge_name='br-int',has_traffic_filtering=True,id=f173e853-6ea8-452e-8db2-e8a975c2f5df,network=Network(a9ab1c2c-271a-4606-b53d-a309e4992de9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf173e853-6e')
Nov 21 14:26:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Deleting instance files /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca_del
Nov 21 14:26:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Deletion of /opt/stack/data/nova/instances/ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca_del complete
Nov 21 14:26:17 user nova-compute[74882]: INFO nova.compute.manager [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 21 14:26:17 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:26:17 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:26:18 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:26:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received event network-vif-deleted-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:18 user nova-compute[74882]: INFO nova.compute.manager [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Neutron deleted interface f173e853-6ea8-452e-8db2-e8a975c2f5df; detaching it from the instance and deleting it from the info cache
Nov 21 14:26:18 user nova-compute[74882]: DEBUG nova.network.neutron [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:26:18 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Took 0.50 seconds to deallocate network for instance.
Nov 21 14:26:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-31ef23ad-7ee9-4a0e-8082-03c7e923a5a3 req-602e0516-f4e7-408c-8bfe-73c592a24d24 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Detach interface failed, port_id=f173e853-6ea8-452e-8db2-e8a975c2f5df, reason: Instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:26:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:18 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:26:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:26:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:18 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Deleted allocations for instance ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca
Nov 21 14:26:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-652e4005-d273-4c14-b76d-4f6bce4731e9 tempest-ServersNegativeTestJSON-1655313892 tempest-ServersNegativeTestJSON-1655313892-project-member] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.705s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received event network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Acquiring lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] Lock "ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] No waiting events found dispatching network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:26:19 user nova-compute[74882]: WARNING nova.compute.manager [req-f9ffe9f7-ab9e-45ac-bd3d-d9a52479ef5e req-d2ea5871-d6e9-4bcf-bec3-c672932ffdc0 service nova] [instance: ed1f7f9a-8d53-4f8d-b508-2d61bc3f3dca] Received unexpected event network-vif-plugged-f173e853-6ea8-452e-8db2-e8a975c2f5df for instance with vm_state deleted and task_state None.
Nov 21 14:26:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfwEimYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:21 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d64de-2d9c-4586-a456-d26ce84e524e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:26:21 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3883f0a-0282-4177-aa85-ffc1cb69ce09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64] added
Nov 21 14:26:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb398d71-ef4a-473b-9f32-05a8348357d1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d22bf6-e705-40eb-8d01-6e67ba37eb5f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfwEimYB {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfwEimYB" returned: 0 in 0.044s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[074d0fa2-7bb5-41cd-a7ce-8b6524c11b8c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RfwEimYB'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[88790a3e-7ed5-448a-b5bd-9c99111d9550]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8189c3b-09bc-4b06-9e6b-2fd0ecf1ddd3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0e5038-6c25-4377-9c42-b76a20913edf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260]
Nov 21 14:26:21 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260] successful.
Nov 21 14:26:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e682a3c-a083-4f54-a57e-ed74fe2b0367]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb006c6-a13a-4954-9503-3b693577d60b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)
Nov 21 14:26:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e891d1-3fd5-4754-b37b-20658efa4f44]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfwEimYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:26:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23334306265623234', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334306265623234', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG nova.objects.instance [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:26:22 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:26:22 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:26:22 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:26:22 user nova-compute[74882]:   <serial>eecc96a4-4c9d-4267-8b5f-446fda932a64</serial>
Nov 21 14:26:22 user nova-compute[74882]: </disk>
Nov 21 14:26:22 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No VIF found with MAC fa:16:3e:3f:6d:85, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:26:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-fa43e81e-c008-4e97-a593-0abaabf18c61 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.151s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:23 user nova-compute[74882]: INFO nova.compute.manager [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Detaching volume d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:26:23 user nova-compute[74882]: INFO nova.virt.block_device [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Attempting to driver detach volume d6daff34-cae1-4f15-a582-55aeaead48de from mountpoint /dev/vdb
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Attempting to detach device vdb from instance e29684d3-c5fd-4336-abc3-5da416e300e2 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:26:23 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:26:23 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:26:23 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:26:23 user nova-compute[74882]:   <serial>d6daff34-cae1-4f15-a582-55aeaead48de</serial>
Nov 21 14:26:23 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:26:23 user nova-compute[74882]: </disk>
Nov 21 14:26:23 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:26:23 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully detached device vdb from instance e29684d3-c5fd-4336-abc3-5da416e300e2 from the persistent domain config.
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e29684d3-c5fd-4336-abc3-5da416e300e2 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:26:23 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:26:23 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:26:23 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:26:23 user nova-compute[74882]:   <serial>d6daff34-cae1-4f15-a582-55aeaead48de</serial>
Nov 21 14:26:23 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:26:23 user nova-compute[74882]: </disk>
Nov 21 14:26:23 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:23 user nova-compute[74882]: INFO nova.compute.manager [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Detaching volume eecc96a4-4c9d-4267-8b5f-446fda932a64
Nov 21 14:26:23 user nova-compute[74882]: INFO nova.virt.block_device [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Attempting to driver detach volume eecc96a4-4c9d-4267-8b5f-446fda932a64 from mountpoint /dev/vdb
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Attempting to detach device vdb from instance a76d5dda-a6c7-4e62-8471-16c8c99344da from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:26:23 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:26:23 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:26:23 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:26:23 user nova-compute[74882]:   <serial>eecc96a4-4c9d-4267-8b5f-446fda932a64</serial>
Nov 21 14:26:23 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:26:23 user nova-compute[74882]: </disk>
Nov 21 14:26:23 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:26:23 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully detached device vdb from instance a76d5dda-a6c7-4e62-8471-16c8c99344da from the persistent domain config.
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a76d5dda-a6c7-4e62-8471-16c8c99344da from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:26:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:26:23 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:26:23 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:26:23 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:26:23 user nova-compute[74882]:   <serial>eecc96a4-4c9d-4267-8b5f-446fda932a64</serial>
Nov 21 14:26:23 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:26:23 user nova-compute[74882]: </disk>
Nov 21 14:26:23 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:26:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:26:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:26:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7420MB free_disk=25.357620239257812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e29684d3-c5fd-4336-abc3-5da416e300e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4238ef1f-4d57-472f-b902-33aae507931b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9fe53976-492f-40b7-bf48-cfbfc337af0f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance a76d5dda-a6c7-4e62-8471-16c8c99344da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance aa2e856f-1904-4a99-ba39-4e05adbe2360 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:26:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:26:33 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:26:33 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:26:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [{"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-7892830a-13fc-48a2-bfd3-29a96b2a9113" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:26:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:26:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lazy-loading 'flavor' on Instance uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:43 user nova-compute[74882]: INFO nova.compute.manager [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Attaching volume 80204876-2834-4680-8b28-90fd14c4ae35 to /dev/vdb
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.utils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[118c0771-f833-4980-813e-ba2bbb96f7c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1c37b8-5893-4a75-84ae-b26082c0608d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea8c594-af87-492d-899a-0cf88df2641f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[624741f4-78e6-49dd-90d9-17e2d23828ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:26:43 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ce562-2fbc-4dd1-98ba-a84e3a8c17f5]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.utils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating existing volume attachment record: f74fc59c-371d-4255-991f-1278c23741a9 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:26:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e29684d3-c5fd-4336-abc3-5da416e300e2 is timed out.
Nov 21 14:26:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully detached device vdb from instance e29684d3-c5fd-4336-abc3-5da416e300e2 from the live domain config.
Nov 21 14:26:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQGEHoPB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:43 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0821a1dd-697d-44e0-9e1f-291c7b840bbd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:26:43 user nova-compute[74882]: No targets found.
Nov 21 14:26:43 user nova-compute[74882]: iSNS:
Nov 21 14:26:43 user nova-compute[74882]: No targets found.
Nov 21 14:26:43 user nova-compute[74882]: STATIC:
Nov 21 14:26:43 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:26:43 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:43 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:43 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:26:43 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:43 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:43 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de
Nov 21 14:26:43 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:43 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:43 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64
Nov 21 14:26:43 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:43 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:43 user nova-compute[74882]: FIRMWARE:
Nov 21 14:26:43 user nova-compute[74882]: No targets found.
Nov 21 14:26:43 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:26:43 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:26:43 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edf4bba-eb25-40a8-bb31-39318dc46a67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[69641f78-bfa0-47a4-b7ea-7125eae17702]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:26:43 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:43 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:43 user nova-compute[74882]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)
Nov 21 14:26:43 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de (non-flash)
Nov 21 14:26:43 user nova-compute[74882]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:43 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:43 user nova-compute[74882]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)
Nov 21 14:26:43 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c556c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2c8a49-2004-4950-8aef-763b97af3c7c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[543561d0-427b-4349-9a1c-19a94555db46]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2d7b43-db57-442b-b4c4-0e8ecc3fa6cf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9aa3e7-6222-4dd0-bf6c-1df4acdb0d8c]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f603a00a-ba01-4014-acde-2fc11a856610]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --logout" returned: 0 in 0.128s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[742b2fa9-4379-4efd-a7d5-8df3c7829e83]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260]
Nov 21 14:26:44 user nova-compute[74882]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de, portal: 172.16.0.220,3260] successful.
Nov 21 14:26:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6daff34-cae1-4f15-a582-55aeaead48de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ede6d2-94b4-4734-9616-514477f0d7d9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== disconnect_volume: return (360ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:26:44 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a76d5dda-a6c7-4e62-8471-16c8c99344da is timed out.
Nov 21 14:26:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully detached device vdb from instance a76d5dda-a6c7-4e62-8471-16c8c99344da from the live domain config.
Nov 21 14:26:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfwEimYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:44 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fdb359-6bed-49ce-bc71-28a78b8da810]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:26:44 user nova-compute[74882]: No targets found.
Nov 21 14:26:44 user nova-compute[74882]: iSNS:
Nov 21 14:26:44 user nova-compute[74882]: No targets found.
Nov 21 14:26:44 user nova-compute[74882]: STATIC:
Nov 21 14:26:44 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:26:44 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:44 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:44 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:26:44 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:44 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:44 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64
Nov 21 14:26:44 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:44 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:44 user nova-compute[74882]: FIRMWARE:
Nov 21 14:26:44 user nova-compute[74882]: No targets found.
Nov 21 14:26:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:26:44 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:26:44 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[84524124-831a-418e-98c1-2b1d016bf0ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f983a37-937e-4e0a-b381-d0d5aa2b5215]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:44 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:44 user nova-compute[74882]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)
Nov 21 14:26:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:44 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:44 user nova-compute[74882]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 (non-flash)
Nov 21 14:26:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6e3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0dbd5-af4a-4a1b-b965-1c3c201349f4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6bc9bd-81fc-456c-965d-ffaad4653ffd]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a243e3be-1357-4c2f-bee6-2ffa70b9581a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad96660-c63d-433f-9973-725c0fa5c974]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bdcda7-8a40-4f13-a198-28fde6482033]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bebe27-9a8d-471d-9b91-8966a8f3d75d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260]
Nov 21 14:26:44 user nova-compute[74882]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64, portal: 172.16.0.220,3260] successful.
Nov 21 14:26:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eecc96a4-4c9d-4267-8b5f-446fda932a64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d57d14-983b-4db6-a496-693012f6b8f8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== disconnect_volume: return (315ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG nova.objects.instance [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG nova.objects.instance [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'flavor' on Instance uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-35e5064f-8b60-489d-92dd-7ce81fe000ef tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.015s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db866271-8160-43d6-9b53-a0d0bfa3e758 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:49 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[30126971-cebd-4421-9f09-192e4c8b5e61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:26:49 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb2594f-5f18-4160-bfca-36a8c7d02899]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35] added
Nov 21 14:26:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0813673-b288-4a6b-b56e-5445319c38ef]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9907856-f414-45ac-80cb-04280fbeba39]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjqTdmgH {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjqTdmgH" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[66106a0e-ff07-416a-8380-efd5fa5d87d0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NjqTdmgH'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[283440bc-e539-45ef-8aee-ede8e8366b7a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee231fa-04e3-45fe-bbcf-37c2fff2b67c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eccefd-ef7b-46aa-b23a-3d7038f8fcf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]
Nov 21 14:26:49 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.
Nov 21 14:26:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[48be7672-25b7-4c48-a4fa-4c729028a948]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e17ceb-c312-49c3-a73b-ddcb869037b6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:26:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:26:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c7133-73fa-45ec-864f-ee7eb20b5140]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23665346634303731', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665346634303731', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG nova.objects.instance [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lazy-loading 'flavor' on Instance uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:26:51 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:26:51 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:26:51 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:26:51 user nova-compute[74882]:   <serial>80204876-2834-4680-8b28-90fd14c4ae35</serial>
Nov 21 14:26:51 user nova-compute[74882]: </disk>
Nov 21 14:26:51 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No VIF found with MAC fa:16:3e:c6:d9:99, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:26:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3b0ae89d-c054-4130-886a-1ffeaa1b0d3d tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.161s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:53 user nova-compute[74882]: INFO nova.compute.manager [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Terminating instance
Nov 21 14:26:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Stashing vm_state: active {{(pid=74882) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-unplugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-unplugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-b8635b29-5545-44d1-af41-06955ba12135 req-54910aa0-469d-4efa-aa5a-d6ea24cdbb07 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-unplugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:26:53 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:26:53 user nova-compute[74882]: INFO nova.compute.claims [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Claim successful on node user
Nov 21 14:26:53 user nova-compute[74882]: INFO nova.compute.resource_tracker [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating resource usage from migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff
Nov 21 14:26:53 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:26:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Instance destroyed successfully.
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lazy-loading 'resources' on Instance uuid 9fe53976-492f-40b7-bf48-cfbfc337af0f {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-502558027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2116261026',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzSSyXlzqE9HWV5D9xNCNaHAa/8qW7iQ87gDowxkTy3UZ/x+eWWMIw/Z9nomrT8J/h8Pa5O/2Fn1eQ1/iYqvGmhapWyfprtgMcYbgJpsjpLdAbOg5GOfsOa4Op/nEyakg==',key_name='tempest-keypair-993669652',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:25:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a906ab977ca047e8aacb9c696f166a20',ramdisk_id='',reservation_id='r-0p86wt1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-434641624',owner_user_name='tempest-ServerActionsV293TestJSON-434641624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:25:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff48456740444cf8aee032129cc9f087',uuid=9fe53976-492f-40b7-bf48-cfbfc337af0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converting VIF {"id": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "address": "fa:16:3e:53:e9:6f", "network": {"id": "752c2c0f-3522-4c30-9f16-3e3678ceb9dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1244783660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a906ab977ca047e8aacb9c696f166a20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7ae295-69", "ovs_interfaceid": "9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_vif [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f7ae295-69, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.457s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:54 user nova-compute[74882]: INFO nova.compute.manager [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Migrating
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:26:54 user nova-compute[74882]: INFO nova.compute.rpcapi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1a6b4ea-49a3-4329-a8fb-fe89a77e0b69) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:26:54 user nova-compute[74882]: INFO os_vif [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e9:6f,bridge_name='br-int',has_traffic_filtering=True,id=9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1,network=Network(752c2c0f-3522-4c30-9f16-3e3678ceb9dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f7ae295-69')
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvMlNsDL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:54 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d7a349-1882-4d61-a3f0-c1fff88966a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:26:54 user nova-compute[74882]: No targets found.
Nov 21 14:26:54 user nova-compute[74882]: iSNS:
Nov 21 14:26:54 user nova-compute[74882]: No targets found.
Nov 21 14:26:54 user nova-compute[74882]: STATIC:
Nov 21 14:26:54 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:26:54 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:54 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:54 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:26:54 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:54 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:54 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9
Nov 21 14:26:54 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:54 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:54 user nova-compute[74882]: FIRMWARE:
Nov 21 14:26:54 user nova-compute[74882]: No targets found.
Nov 21 14:26:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:26:54 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:26:54 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb1b16f-a68d-4f9a-944d-9881b7191f96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7550023-df22-45d9-9594-61ff2b44b538]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:54 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:54 user nova-compute[74882]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:26:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:54 user nova-compute[74882]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 (non-flash)
Nov 21 14:26:54 user nova-compute[74882]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:26:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c50bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a14ecfb-66a6-43f7-9abf-30b795514ee0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8136a4-1efd-4801-8d7d-764d5d630806]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c1585-8131-47ed-8e37-a55d8d574704]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd886e70-01bf-4cd6-9de9-7e0d4ed29190]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[03060dc8-2776-4630-91d9-02f9dee5d8fd]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f6ee4-7149-4269-9ee0-9e241979c873]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260]
Nov 21 14:26:54 user nova-compute[74882]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9, portal: 172.16.0.220,3260] successful.
Nov 21 14:26:54 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3334939e-afed-4b86-8d82-eda72f7b2ff9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9815a3-0f8e-43f6-919d-8d48cb9ea631]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] <== disconnect_volume: return (342ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:26:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Deleting instance files /opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f_del
Nov 21 14:26:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Deletion of /opt/stack/data/nova/instances/9fe53976-492f-40b7-bf48-cfbfc337af0f_del complete
Nov 21 14:26:54 user nova-compute[74882]: INFO nova.compute.manager [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Starting migrate_disk_and_power_off {{(pid=74882) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:26:55 user nova-compute[74882]: WARNING nova.compute.manager [req-1780c77d-2ef1-48bd-8a8a-9cf78b2ccdd9 req-162f9543-edc1-4596-a4d4-f905f85378f1 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state active and task_state resize_migrating.
Nov 21 14:26:55 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance destroyed successfully.
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-309229548-network", "vif_mac": "fa:16:3e:c6:d9:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-309229548-network", "vif_mac": "fa:16:3e:c6:d9:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_vif [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23e1e132-07, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bddb8c1c-08eb-4849-b881-0cc5d6dd4585) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:26:55 user nova-compute[74882]: INFO os_vif [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07')
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:55 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ffd81d-768e-4312-87ec-7f8bb5865128]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:26:55 user nova-compute[74882]: No targets found.
Nov 21 14:26:55 user nova-compute[74882]: iSNS:
Nov 21 14:26:55 user nova-compute[74882]: No targets found.
Nov 21 14:26:55 user nova-compute[74882]: STATIC:
Nov 21 14:26:55 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:26:55 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:55 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:55 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:26:55 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:26:55 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:26:55 user nova-compute[74882]: FIRMWARE:
Nov 21 14:26:55 user nova-compute[74882]: No targets found.
Nov 21 14:26:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:26:55 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:26:55 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6676b7-4f73-436c-b222-c76160302141]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:55 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Took 1.10 seconds to deallocate network for instance.
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e48295-7365-40ac-ac62-72ffd1d42920]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:55 user nova-compute[74882]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:26:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:26:55 user nova-compute[74882]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:26:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c5eda20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b917f35-074d-4067-982a-e292f6d6919e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Acquiring lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] No waiting events found dispatching network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:26:55 user nova-compute[74882]: WARNING nova.compute.manager [req-a7513b3c-eb04-492a-a9ea-d8db274ec3ad req-8cc27227-265b-4e24-85d0-a241128cd822 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received unexpected event network-vif-plugged-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 for instance with vm_state active and task_state deleting.
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46439b2-9f39-45d8-9acc-d68bcbb08133]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7aea01-ba9b-480a-97d4-24fc4449ad4f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[505b2de3-8dfb-4dfb-b39f-314262fd71af]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c71db-b1d5-4030-8448-545c634a8a78]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[384dad26-3507-4293-9d9e-d3993929e4d2]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]
Nov 21 14:26:55 user nova-compute[74882]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.
Nov 21 14:26:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf8b02-b7a4-43e9-9a66-f24118033092]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== disconnect_volume: return (297ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:26:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0_resize/disk /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:56 user nova-compute[74882]: INFO nova.compute.manager [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Took 0.76 seconds to detach 1 volumes for instance.
Nov 21 14:26:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Deleting volume: 3334939e-afed-4b86-8d82-eda72f7b2ff9 {{(pid=74882) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "cp -r /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0_resize/disk /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk" returned: 0 in 0.457s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0_resize/disk.info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk.info {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "cp -r /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0_resize/disk.info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk.info" returned: 0 in 0.057s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:26:57 user nova-compute[74882]: WARNING nova.compute.manager [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state active and task_state resize_migrating.
Nov 21 14:26:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-58737980-bf84-4f20-9e74-512c4e49dc66 req-ae0906cc-49be-4570-b05e-721ceddf1456 service nova] [instance: 9fe53976-492f-40b7-bf48-cfbfc337af0f] Received event network-vif-deleted-9f7ae295-69a0-49e0-b9a4-9f7a7b9b1ff1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:26:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.858s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:57 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Deleted allocations for instance 9fe53976-492f-40b7-bf48-cfbfc337af0f
Nov 21 14:26:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2b46197e-ac5e-4fb2-bd05-c4c04ae79e7f tempest-ServerActionsV293TestJSON-434641624 tempest-ServerActionsV293TestJSON-434641624-project-member] Lock "9fe53976-492f-40b7-bf48-cfbfc337af0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.297s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Port 23e1e132-07a0-4650-9032-872a2dfeafb4 binding to destination host user is already ACTIVE {{(pid=74882) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 21 14:26:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:26:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:26:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:26:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:26:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:26:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG os_brick.utils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3a6972-8c02-43fc-afe3-74020a2cb60d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.164s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7282ca7-a98e-498e-bf90-118173261299]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f36508-37a8-47e9-93bf-60cd15adbc6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de80c0-b58c-4904-a255-3a4a7bd0fa9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:26:59 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:26:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1675e3b9-554a-41bc-b279-8140d24f44e5]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:26:59 user nova-compute[74882]: DEBUG os_brick.utils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== get_connector_properties: return (267ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:27:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:02 user nova-compute[74882]: INFO nova.compute.manager [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Rescuing
Nov 21 14:27:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating instance_info_cache with network_info: [{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:02 user nova-compute[74882]: WARNING nova.compute.manager [req-afc30382-7b08-4e0b-9105-8a859b51382a req-bf0739a5-6a9b-4730-a149-7ff08a2f07d7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state active and task_state rescuing.
Nov 21 14:27:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "aa2e856f-1904-4a99-ba39-4e05adbe2360" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:03 user nova-compute[74882]: INFO nova.compute.manager [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Terminating instance
Nov 21 14:27:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance destroyed successfully.
Nov 21 14:27:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Attempting a stable device rescue
Nov 21 14:27:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74882) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:27:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Creating image(s)
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "d7459f763ccd8df3f11e91acea1ebbb415fdb2d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "d7459f763ccd8df3f11e91acea1ebbb415fdb2d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received event network-vif-unplugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Acquiring lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] No waiting events found dispatching network-vif-unplugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-3850d08a-01ac-44dd-a889-175662411545 req-5a09f876-5127-473c-a129-3837cd6fd767 service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received event network-vif-unplugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:27:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Instance destroyed successfully.
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'resources' on Instance uuid aa2e856f-1904-4a99-ba39-4e05adbe2360 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-115556004',display_name='tempest-VolumesAdminNegativeTest-server-115556004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-115556004',id=21,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a26cdaa13ed94137bcb577358a2054dc',ramdisk_id='',reservation_id='r-sy56gmcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-564618194',owner_user_name='tempest-VolumesAdminNegativeTest-564618194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:25:13Z,user_data=None,user_id='85844a0bfabd4095b647684ad7a1003a',uuid=aa2e856f-1904-4a99-ba39-4e05adbe2360,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converting VIF {"id": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "address": "fa:16:3e:0a:51:b5", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap983863ad-bb", "ovs_interfaceid": "983863ad-bbc2-4827-ac00-16638fbbf0a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:51:b5,bridge_name='br-int',has_traffic_filtering=True,id=983863ad-bbc2-4827-ac00-16638fbbf0a7,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983863ad-bb') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG os_vif [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:51:b5,bridge_name='br-int',has_traffic_filtering=True,id=983863ad-bbc2-4827-ac00-16638fbbf0a7,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983863ad-bb') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap983863ad-bb, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79554040-8550-4526-9100-f1f7d69a53a7) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:04 user nova-compute[74882]: INFO os_vif [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:51:b5,bridge_name='br-int',has_traffic_filtering=True,id=983863ad-bbc2-4827-ac00-16638fbbf0a7,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap983863ad-bb')
Nov 21 14:27:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Deleting instance files /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360_del
Nov 21 14:27:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Deletion of /opt/stack/data/nova/instances/aa2e856f-1904-4a99-ba39-4e05adbe2360_del complete
Nov 21 14:27:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.virt.images [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 7d1c98b6-5171-4cd1-a8e6-1823e58e1598 was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.part /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:04 user nova-compute[74882]: INFO nova.compute.manager [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 21 14:27:04 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:04 user nova-compute[74882]: WARNING nova.compute.manager [req-bdd4d918-849b-405f-a3b9-43058816bc11 req-7cfe46c3-e686-4937-ae8b-5ee6f17a0204 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state active and task_state rescuing.
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.part /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.converted" returned: 0 in 0.513s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received event network-vif-deleted-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:05 user nova-compute[74882]: INFO nova.compute.manager [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Neutron deleted interface 983863ad-bbc2-4827-ac00-16638fbbf0a7; detaching it from the instance and deleting it from the info cache
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.network.neutron [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:05 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Took 0.62 seconds to deallocate network for instance.
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-5a3d6049-cfc4-40b8-91a1-e21c2e11cc9d req-fe650fc9-ef5a-4b44-8836-ce39432521db service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Detach interface failed, port_id=983863ad-bbc2-4827-ac00-16638fbbf0a7, reason: Instance aa2e856f-1904-4a99-ba39-4e05adbe2360 could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "d7459f763ccd8df3f11e91acea1ebbb415fdb2d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.900s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "d7459f763ccd8df3f11e91acea1ebbb415fdb2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "d7459f763ccd8df3f11e91acea1ebbb415fdb2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received event network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Acquiring lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] No waiting events found dispatching network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:05 user nova-compute[74882]: WARNING nova.compute.manager [req-68f72a2c-f0a6-45b3-acf1-4c66c0410657 req-98014a61-1395-473e-b3c8-87f48e64b99a service nova] [instance: aa2e856f-1904-4a99-ba39-4e05adbe2360] Received unexpected event network-vif-plugged-983863ad-bbc2-4827-ac00-16638fbbf0a7 for instance with vm_state deleted and task_state None.
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9,backing_fmt=raw /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9,backing_fmt=raw /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue" returned: 0 in 0.057s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "d7459f763ccd8df3f11e91acea1ebbb415fdb2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'migration_context' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<5dddf05e-1c0b-42a2-8fd0-22ce4a539d44> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Start _get_guest_xml network_info=[{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "vif_mac": "fa:16:3e:86:06:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7d1c98b6-5171-4cd1-a8e6-1823e58e1598', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLoreNDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5dddf05e-1c0b-42a2-8fd0-22ce4a539d44', 'attached_at': '', 'detached_at': '', 'volume_id': 'cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'serial': 'cea0a613-7c3f-40c3-8a2a-fe3d8871e750'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'e8fa5546-248e-417a-a019-b53c75c81e03', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'resources' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<5dddf05e-1c0b-42a2-8fd0-22ce4a539d44> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'numa_topology' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<5dddf05e-1c0b-42a2-8fd0-22ce4a539d44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:27:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:27:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Starting finish_migration {{(pid=74882) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:27:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Creating image(s)
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.objects.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<5dddf05e-1c0b-42a2-8fd0-22ce4a539d44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLoreNDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:27:05 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:27:05 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:27:05 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a555b8e0-3fdf-4d94-a347-3ebf5b603075]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TLoreNDm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 21 14:27:05 user nova-compute[74882]: node.name = iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:27:05 user nova-compute[74882]: node.tpgt = -1
Nov 21 14:27:05 user nova-compute[74882]: node.startup = automatic
Nov 21 14:27:05 user nova-compute[74882]: node.leading_login = No
Nov 21 14:27:05 user nova-compute[74882]: iface.iscsi_ifacename = default
Nov 21 14:27:05 user nova-compute[74882]: iface.net_ifacename = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.ipaddress = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.prefix_len = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.hwaddress = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.transport_name = tcp
Nov 21 14:27:05 user nova-compute[74882]: iface.initiatorname = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.state = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.vlan_id = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.vlan_priority = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.vlan_state = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.iface_num = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.mtu = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.port = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.bootproto = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.subnet_mask = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.gateway = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_alt_client_id_state = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_alt_client_id = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_dns = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_learn_iqn = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_req_vendor_id_state = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_vendor_id_state = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_vendor_id = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.dhcp_slp_da = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.fragmentation = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.gratuitous_arp = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.incoming_forwarding = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.tos_state = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.tos = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.ttl = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.delayed_ack = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.tcp_nagle = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.tcp_wsf_state = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.tcp_wsf = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.tcp_timer_scale = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.tcp_timestamp = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.redirect = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.def_task_mgmt_timeout = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.header_digest = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.data_digest = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.immediate_data = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.initial_r2t = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.data_seq_inorder = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.data_pdu_inorder = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.erl = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.max_receive_data_len = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.first_burst_len = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.max_outstanding_r2t = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.max_burst_len = 0
Nov 21 14:27:05 user nova-compute[74882]: iface.chap_auth = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.bidi_chap = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.strict_login_compliance = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.discovery_auth = <empty>
Nov 21 14:27:05 user nova-compute[74882]: iface.discovery_logout = <empty>
Nov 21 14:27:05 user nova-compute[74882]: node.discovery_address = <empty>
Nov 21 14:27:05 user nova-compute[74882]: node.discovery_port = 0
Nov 21 14:27:05 user nova-compute[74882]: node.discovery_type = static
Nov 21 14:27:05 user nova-compute[74882]: node.session.initial_cmdsn = 0
Nov 21 14:27:05 user nova-compute[74882]: node.session.initial_login_retry_max = 8
Nov 21 14:27:05 user nova-compute[74882]: node.session.xmit_thread_priority = -20
Nov 21 14:27:05 user nova-compute[74882]: node.session.cmds_max = 128
Nov 21 14:27:05 user nova-compute[74882]: node.session.queue_depth = 32
Nov 21 14:27:05 user nova-compute[74882]: node.session.nr_sessions = 1
Nov 21 14:27:05 user nova-compute[74882]: node.session.auth.authmethod = CHAP
Nov 21 14:27:05 user nova-compute[74882]: node.session.auth.username = TLoreNDm
Nov 21 14:27:05 user nova-compute[74882]: node.session.auth.password = ***
Nov 21 14:27:05 user nova-compute[74882]: node.session.auth.username_in = <empty>
Nov 21 14:27:05 user nova-compute[74882]: node.session.auth.password_in = <empty>
Nov 21 14:27:05 user nova-compute[74882]: node.session.auth.chap_algs = MD5
Nov 21 14:27:05 user nova-compute[74882]: node.session.timeo.replacement_timeout = 120
Nov 21 14:27:05 user nova-compute[74882]: node.session.err_timeo.abort_timeout = 15
Nov 21 14:27:05 user nova-compute[74882]: node.session.err_timeo.lu_reset_timeout = 30
Nov 21 14:27:05 user nova-compute[74882]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 21 14:27:05 user nova-compute[74882]: node.session.err_timeo.host_reset_timeout = 60
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.FastAbort = Yes
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.InitialR2T = No
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.ImmediateData = Yes
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.FirstBurstLength = 262144
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.MaxBurstLength = 16776192
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.DefaultTime2Retain = 0
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.DefaultTime2Wait = 2
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.MaxConnections = 1
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 21 14:27:05 user nova-compute[74882]: node.session.iscsi.ERL = 0
Nov 21 14:27:05 user nova-compute[74882]: node.session.scan = manual
Nov 21 14:27:05 user nova-compute[74882]: node.session.reopen_max = 0
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].address = 172.16.0.220
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].port = 3260
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].startup = manual
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].tcp.window_size = 524288
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].tcp.type_of_service = 0
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].timeo.logout_timeout = 15
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].timeo.login_timeout = 15
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].timeo.auth_timeout = 45
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].timeo.noop_out_interval = 5
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].timeo.noop_out_timeout = 5
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].iscsi.HeaderDigest = None
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].iscsi.DataDigest = None
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].iscsi.IFMarker = No
Nov 21 14:27:05 user nova-compute[74882]: node.conn[0].iscsi.OFMarker = No
Nov 21 14:27:05 user nova-compute[74882]: # END RECORD
Nov 21 14:27:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a65e16-9097-468a-b30b-e2ad2a3767f8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cf9bfc-0632-4073-9be0-20e96caedaa7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLoreNDm {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLoreNDm" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f75fc6-b92e-44f0-ab3e-49ab7f556e90]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLoreNDm'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk. size=21474836480 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[546431fc-bda3-41d4-98e7-b95e0745bddc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5294b4-235e-4c2e-9083-96c84cd884d5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HCTL ('33', '0', '0', 0) found on session 26 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[28714bbe-9176-4ffb-b9e2-847d8e2c5d68]: (4, ('0 0 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching for a device in session 26 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLoreNDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23066656461643831', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066656461643831', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:27:06 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Deleted allocations for instance aa2e856f-1904-4a99-ba39-4e05adbe2360
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677425991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677425991',id=22,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:25:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-jwp56qp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:25:30Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=5dddf05e-1c0b-42a2-8fd0-22ce4a539d44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "vif_mac": "fa:16:3e:86:06:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "vif_mac": "fa:16:3e:86:06:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.objects.base [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<5dddf05e-1c0b-42a2-8fd0-22ce4a539d44> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:27:06 user nova-compute[74882]:   <uuid>5dddf05e-1c0b-42a2-8fd0-22ce4a539d44</uuid>
Nov 21 14:27:06 user nova-compute[74882]:   <name>instance-00000016</name>
Nov 21 14:27:06 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:27:06 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:27:06 user nova-compute[74882]:   <metadata>
Nov 21 14:27:06 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:27:06 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:27:06 user nova-compute[74882]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-677425991</nova:name>
Nov 21 14:27:06 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:27:05</nova:creationTime>
Nov 21 14:27:06 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:27:06 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:27:06 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:27:06 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:27:06 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:27:06 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:27:06 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:27:06 user nova-compute[74882]:       <nova:owner>
Nov 21 14:27:06 user nova-compute[74882]:         <nova:user uuid="7635b3029cf14950a1978282d06bc8f3">tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member</nova:user>
Nov 21 14:27:06 user nova-compute[74882]:         <nova:project uuid="96e5113ec65d46c4b8859c4658433b02">tempest-ServerBootFromVolumeStableRescueTest-1086017756</nova:project>
Nov 21 14:27:06 user nova-compute[74882]:       </nova:owner>
Nov 21 14:27:06 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:27:06 user nova-compute[74882]:       <nova:ports>
Nov 21 14:27:06 user nova-compute[74882]:         <nova:port uuid="2af316c0-8063-431b-b1a8-cdb069de9c03">
Nov 21 14:27:06 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 21 14:27:06 user nova-compute[74882]:         </nova:port>
Nov 21 14:27:06 user nova-compute[74882]:       </nova:ports>
Nov 21 14:27:06 user nova-compute[74882]:     </nova:instance>
Nov 21 14:27:06 user nova-compute[74882]:   </metadata>
Nov 21 14:27:06 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:27:06 user nova-compute[74882]:     <system>
Nov 21 14:27:06 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:27:06 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:27:06 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:27:06 user nova-compute[74882]:       <entry name="serial">5dddf05e-1c0b-42a2-8fd0-22ce4a539d44</entry>
Nov 21 14:27:06 user nova-compute[74882]:       <entry name="uuid">5dddf05e-1c0b-42a2-8fd0-22ce4a539d44</entry>
Nov 21 14:27:06 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:27:06 user nova-compute[74882]:     </system>
Nov 21 14:27:06 user nova-compute[74882]:   </sysinfo>
Nov 21 14:27:06 user nova-compute[74882]:   <os>
Nov 21 14:27:06 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:27:06 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:27:06 user nova-compute[74882]:   </os>
Nov 21 14:27:06 user nova-compute[74882]:   <features>
Nov 21 14:27:06 user nova-compute[74882]:     <acpi/>
Nov 21 14:27:06 user nova-compute[74882]:     <apic/>
Nov 21 14:27:06 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:27:06 user nova-compute[74882]:   </features>
Nov 21 14:27:06 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:27:06 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:27:06 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:27:06 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:27:06 user nova-compute[74882]:   </clock>
Nov 21 14:27:06 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:27:06 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:27:06 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:27:06 user nova-compute[74882]:   </cpu>
Nov 21 14:27:06 user nova-compute[74882]:   <devices>
Nov 21 14:27:06 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:27:06 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:27:06 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:27:06 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:27:06 user nova-compute[74882]:       <serial>cea0a613-7c3f-40c3-8a2a-fe3d8871e750</serial>
Nov 21 14:27:06 user nova-compute[74882]:     </disk>
Nov 21 14:27:06 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:27:06 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:27:06 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue"/>
Nov 21 14:27:06 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:27:06 user nova-compute[74882]:       <boot order="1"/>
Nov 21 14:27:06 user nova-compute[74882]:     </disk>
Nov 21 14:27:06 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:27:06 user nova-compute[74882]:       <mac address="fa:16:3e:86:06:ac"/>
Nov 21 14:27:06 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:27:06 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:27:06 user nova-compute[74882]:       <target dev="tap2af316c0-80"/>
Nov 21 14:27:06 user nova-compute[74882]:     </interface>
Nov 21 14:27:06 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:27:06 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/console.log" append="off"/>
Nov 21 14:27:06 user nova-compute[74882]:     </serial>
Nov 21 14:27:06 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:27:06 user nova-compute[74882]:     <video>
Nov 21 14:27:06 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:27:06 user nova-compute[74882]:     </video>
Nov 21 14:27:06 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:27:06 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:27:06 user nova-compute[74882]:     </rng>
Nov 21 14:27:06 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:27:06 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:27:06 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:27:06 user nova-compute[74882]:     </memballoon>
Nov 21 14:27:06 user nova-compute[74882]:   </devices>
Nov 21 14:27:06 user nova-compute[74882]: </domain>
Nov 21 14:27:06 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:27:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance destroyed successfully.
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk 21474836480 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-61a75af8-23d6-44d1-b57e-b33c04e5e756 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "aa2e856f-1904-4a99-ba39-4e05adbe2360" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.988s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk 21474836480" returned: 0 in 0.055s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Ensure instance console log exists: /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Start _get_guest_xml network_info=[{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-309229548-network", "vif_mac": "fa:16:3e:c6:d9:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '101c9eaa-a8f5-4840-a1d7-454b0be5d5d0', 'attached_at': '2023-11-21T14:27:06.000000', 'detached_at': '', 'volume_id': '80204876-2834-4680-8b28-90fd14c4ae35', 'serial': '80204876-2834-4680-8b28-90fd14c4ae35'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'fcca349f-8a20-4382-b8fd-c87140dec3d7', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No VIF found with MAC fa:16:3e:86:06:ac, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:27:06 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:27:06 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:27:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:27:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:27:06 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ffbc37-be88-4279-9335-13705cd10266]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:27:06 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6aa057-7dd0-42da-8c97-109a3a867c46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35] added
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed151a46-d150-4532-a299-a5109225bf51]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3c5c16-7d83-4e51-b6f9-51a6aa0e47bb]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjqTdmgH {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjqTdmgH" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[17caff1c-f0a4-49e9-b85e-70b98fa5d266]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NjqTdmgH'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4d7ded-ea17-4393-9546-252af0b21500]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a930432-258e-409b-8705-65e43c6cb2e0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b312c857-5c85-4da8-b6cd-7629cb7751b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]
Nov 21 14:27:06 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf3ad97-2532-40e5-9a33-0fc7f79d3d86]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[66589a47-6d0d-43f6-a441-8a609b57763d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f7161-46a8-451f-bb6e-88b632cc90d4]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:27:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23665346634303731', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665346634303731', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-309229548-network", "vif_mac": "fa:16:3e:c6:d9:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-309229548-network", "vif_mac": "fa:16:3e:c6:d9:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:27:07 user nova-compute[74882]:   <uuid>101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</uuid>
Nov 21 14:27:07 user nova-compute[74882]:   <name>instance-00000012</name>
Nov 21 14:27:07 user nova-compute[74882]:   <memory>2097152</memory>
Nov 21 14:27:07 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:27:07 user nova-compute[74882]:   <metadata>
Nov 21 14:27:07 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:27:07 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:27:07 user nova-compute[74882]:       <nova:name>tempest-ServerActionsTestOtherB-server-1299552937</nova:name>
Nov 21 14:27:07 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:27:06</nova:creationTime>
Nov 21 14:27:07 user nova-compute[74882]:       <nova:flavor name="m1.small">
Nov 21 14:27:07 user nova-compute[74882]:         <nova:memory>2048</nova:memory>
Nov 21 14:27:07 user nova-compute[74882]:         <nova:disk>20</nova:disk>
Nov 21 14:27:07 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:27:07 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:27:07 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:27:07 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:27:07 user nova-compute[74882]:       <nova:owner>
Nov 21 14:27:07 user nova-compute[74882]:         <nova:user uuid="a19fbffc4df04656950aa2bb1a2bb48a">tempest-ServerActionsTestOtherB-2073286927-project-member</nova:user>
Nov 21 14:27:07 user nova-compute[74882]:         <nova:project uuid="ccf822369a824ed3912173b2f27fddbf">tempest-ServerActionsTestOtherB-2073286927</nova:project>
Nov 21 14:27:07 user nova-compute[74882]:       </nova:owner>
Nov 21 14:27:07 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:27:07 user nova-compute[74882]:       <nova:ports>
Nov 21 14:27:07 user nova-compute[74882]:         <nova:port uuid="23e1e132-07a0-4650-9032-872a2dfeafb4">
Nov 21 14:27:07 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 21 14:27:07 user nova-compute[74882]:         </nova:port>
Nov 21 14:27:07 user nova-compute[74882]:       </nova:ports>
Nov 21 14:27:07 user nova-compute[74882]:     </nova:instance>
Nov 21 14:27:07 user nova-compute[74882]:   </metadata>
Nov 21 14:27:07 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:27:07 user nova-compute[74882]:     <system>
Nov 21 14:27:07 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:27:07 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:27:07 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:27:07 user nova-compute[74882]:       <entry name="serial">101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</entry>
Nov 21 14:27:07 user nova-compute[74882]:       <entry name="uuid">101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</entry>
Nov 21 14:27:07 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:27:07 user nova-compute[74882]:     </system>
Nov 21 14:27:07 user nova-compute[74882]:   </sysinfo>
Nov 21 14:27:07 user nova-compute[74882]:   <os>
Nov 21 14:27:07 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:27:07 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:27:07 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:27:07 user nova-compute[74882]:   </os>
Nov 21 14:27:07 user nova-compute[74882]:   <features>
Nov 21 14:27:07 user nova-compute[74882]:     <acpi/>
Nov 21 14:27:07 user nova-compute[74882]:     <apic/>
Nov 21 14:27:07 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:27:07 user nova-compute[74882]:   </features>
Nov 21 14:27:07 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:27:07 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:27:07 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:27:07 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:27:07 user nova-compute[74882]:   </clock>
Nov 21 14:27:07 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:27:07 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:27:07 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:27:07 user nova-compute[74882]:   </cpu>
Nov 21 14:27:07 user nova-compute[74882]:   <devices>
Nov 21 14:27:07 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:27:07 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:27:07 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk"/>
Nov 21 14:27:07 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:27:07 user nova-compute[74882]:     </disk>
Nov 21 14:27:07 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:27:07 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:27:07 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 14:27:07 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:27:07 user nova-compute[74882]:       <serial>80204876-2834-4680-8b28-90fd14c4ae35</serial>
Nov 21 14:27:07 user nova-compute[74882]:     </disk>
Nov 21 14:27:07 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:27:07 user nova-compute[74882]:       <mac address="fa:16:3e:c6:d9:99"/>
Nov 21 14:27:07 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:27:07 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:27:07 user nova-compute[74882]:       <target dev="tap23e1e132-07"/>
Nov 21 14:27:07 user nova-compute[74882]:     </interface>
Nov 21 14:27:07 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:27:07 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/console.log" append="off"/>
Nov 21 14:27:07 user nova-compute[74882]:     </serial>
Nov 21 14:27:07 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:27:07 user nova-compute[74882]:     <video>
Nov 21 14:27:07 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:27:07 user nova-compute[74882]:     </video>
Nov 21 14:27:07 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:27:07 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:27:07 user nova-compute[74882]:     </rng>
Nov 21 14:27:07 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:27:07 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:27:07 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:27:07 user nova-compute[74882]:     </memballoon>
Nov 21 14:27:07 user nova-compute[74882]:   </devices>
Nov 21 14:27:07 user nova-compute[74882]: </domain>
Nov 21 14:27:07 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-309229548-network", "vif_mac": "fa:16:3e:c6:d9:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-309229548-network", "vif_mac": "fa:16:3e:c6:d9:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG os_vif [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59bb2502-597a-5fb4-8ec5-6e43ac1122fd', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23e1e132-07, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23e1e132-07, col_values=(('qos', UUID('fa58b5f2-333a-44ed-ad9b-13017fb85d72')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23e1e132-07, col_values=(('external_ids', {'iface-id': '23e1e132-07a0-4650-9032-872a2dfeafb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:d9:99', 'vm-uuid': '101c9eaa-a8f5-4840-a1d7-454b0be5d5d0'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: INFO os_vif [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07')
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] No VIF found with MAC fa:16:3e:c6:d9:99, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.compute.manager [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:07 user nova-compute[74882]: DEBUG nova.compute.manager [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:07 user nova-compute[74882]: WARNING nova.compute.manager [req-49077d1a-10ef-4681-95fd-c1a4b0657608 req-6247d037-a3a1-4b4d-81cf-46392d130ec7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state active and task_state rescuing.
Nov 21 14:27:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-changed-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Refreshing instance network info cache due to event network-changed-2ab935fb-7141-46fd-92c0-9c10ef997044. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Acquiring lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Acquired lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Refreshing network info cache for port 2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:09 user nova-compute[74882]: WARNING nova.compute.manager [req-b92198bd-740d-4397-9025-e4e4896f1783 req-7340710a-3bac-4509-a460-8425dd408c27 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state active and task_state resize_finish.
Nov 21 14:27:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:09 user nova-compute[74882]: WARNING nova.compute.manager [req-1c9fe4af-94bc-497d-aafe-84fab66c1315 req-44863532-8b7a-4e88-8258-b1eb40071d26 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state active and task_state rescuing.
Nov 21 14:27:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updated VIF entry in instance network info cache for port 2ab935fb-7141-46fd-92c0-9c10ef997044. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:27:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating instance_info_cache with network_info: [{"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1c9e125-2820-4597-8444-e9026b1357ad req-c0581637-c720-442a-8f8e-992fd23eb1cd service nova] Releasing lock "refresh_cache-bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:27:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1be9ef7f-8752-4f98-8459-cf10fed714c4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:27:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:27:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance running successfully.
Nov 21 14:27:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Failed to set time: agent not configured {{(pid=74882) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 21 14:27:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-68296598-0f84-4864-a880-25e9a01f8dc3 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] finish_migration finished successfully. {{(pid=74882) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 21 14:27:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:11 user nova-compute[74882]: WARNING nova.compute.manager [req-2a4246e0-5980-4cb7-bff4-1690220b4e1a req-c421f76d-75a9-48cf-b81c-26bb72c28fc3 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state resized and task_state None.
Nov 21 14:27:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:12 user nova-compute[74882]: DEBUG nova.objects.instance [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:13 user nova-compute[74882]: INFO nova.compute.manager [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attaching volume 74f2bc96-8feb-411b-b075-6000893ad60b to /dev/vdb
Nov 21 14:27:13 user nova-compute[74882]: DEBUG os_brick.utils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf984ab0-a2d5-4868-96d4-2b89d641b645]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ae24db-18df-4079-b8ae-9ddb199049cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0263070-8e02-4319-8a05-70ebecce757b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c6b8d-51cd-4cd9-81ea-b4c9def26249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:27:13 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[09471641-4c1b-42b4-8e1d-b49a74cc8420]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG os_brick.utils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating existing volume attachment record: 6e54ec26-a288-4fa8-959b-08b97042f7d9 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:13 user nova-compute[74882]: INFO nova.compute.manager [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Terminating instance
Nov 21 14:27:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-unplugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-unplugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-8b77ae2b-b252-4139-abb1-3f9347f07a58 req-c8eae2dd-7f71-42ec-934b-f507716fb4d8 service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-unplugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:14 user nova-compute[74882]: INFO nova.compute.manager [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Terminating instance
Nov 21 14:27:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:27:14 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Instance destroyed successfully.
Nov 21 14:27:14 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'resources' on Instance uuid e29684d3-c5fd-4336-abc3-5da416e300e2 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:21:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1099597183',display_name='tempest-ServerActionsTestOtherA-server-550921415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1099597183',id=15,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8mqZtU9dDhvCuVjxEIBLJPFgcjfX35E31jVHYb6Lc3m9j+jmZLa1yJhH3D2tkKUs7tlnwkb7Cdqz73jwRTxTnN3X/sTnyM3XhOd57QBrQAk0BmSFwJXQhAsNS0DXgKGA==',key_name='tempest-keypair-1536111499',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-2s0r5tw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:23:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=e29684d3-c5fd-4336-abc3-5da416e300e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "address": "fa:16:3e:96:4e:f2", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap767f656d-f7", "ovs_interfaceid": "767f656d-f7c7-4ab0-8727-9c0142c27b7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG os_vif [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap767f656d-f7, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68ded77e-3508-4e60-b17e-422193d28d4e) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: INFO os_vif [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4e:f2,bridge_name='br-int',has_traffic_filtering=True,id=767f656d-f7c7-4ab0-8727-9c0142c27b7f,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap767f656d-f7')
Nov 21 14:27:14 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Deleting instance files /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2_del
Nov 21 14:27:14 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Deletion of /opt/stack/data/nova/instances/e29684d3-c5fd-4336-abc3-5da416e300e2_del complete
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:14 user nova-compute[74882]: INFO nova.compute.manager [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 21 14:27:14 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:27:14 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Instance destroyed successfully.
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'resources' on Instance uuid a76d5dda-a6c7-4e62-8471-16c8c99344da {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-604809217',display_name='tempest-AttachVolumeNegativeTest-server-604809217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-604809217',id=20,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9FoCMa2qacMZrO6msOrTejPTIdqOfPT3wLUrO03PPV4wxLHauD5Ij6qZ9JF9HMPqxdefkjCKf9UBlbZw8SnpjhUYA9sSwwIK+ESGHFVeAYclwTyns1asQc0+1IS2mdxg==',key_name='tempest-keypair-1826925508',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-s03a26gr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:24:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=a76d5dda-a6c7-4e62-8471-16c8c99344da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "address": "fa:16:3e:3f:6d:85", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac3237ae-45", "ovs_interfaceid": "ac3237ae-45f1-4e33-98c3-521fcbe48dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6d:85,bridge_name='br-int',has_traffic_filtering=True,id=ac3237ae-45f1-4e33-98c3-521fcbe48dde,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac3237ae-45') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG os_vif [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6d:85,bridge_name='br-int',has_traffic_filtering=True,id=ac3237ae-45f1-4e33-98c3-521fcbe48dde,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac3237ae-45') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac3237ae-45, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd991962-eb50-46c6-90ac-34fb7b00d821) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:15 user nova-compute[74882]: INFO os_vif [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6d:85,bridge_name='br-int',has_traffic_filtering=True,id=ac3237ae-45f1-4e33-98c3-521fcbe48dde,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac3237ae-45')
Nov 21 14:27:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Deleting instance files /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da_del
Nov 21 14:27:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Deletion of /opt/stack/data/nova/instances/a76d5dda-a6c7-4e62-8471-16c8c99344da_del complete
Nov 21 14:27:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:15 user nova-compute[74882]: INFO nova.compute.manager [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 21 14:27:15 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:15 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Took 0.94 seconds to deallocate network for instance.
Nov 21 14:27:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-815f44fd-f4ba-47fd-b418-0647d4c5de69 req-87b917b9-ea32-4d34-be7d-b4ea89e3563d service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-deleted-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Acquiring lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] No waiting events found dispatching network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:16 user nova-compute[74882]: WARNING nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: e29684d3-c5fd-4336-abc3-5da416e300e2] Received unexpected event network-vif-plugged-767f656d-f7c7-4ab0-8727-9c0142c27b7f for instance with vm_state deleted and task_state None.
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-unplugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-unplugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-unplugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:16 user nova-compute[74882]: WARNING nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received unexpected event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with vm_state active and task_state deleting.
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:16 user nova-compute[74882]: WARNING nova.compute.manager [req-52693ab5-507d-44fe-a61d-90308c4e8776 req-aaf7dba3-3b92-4753-9720-53296f54e10e service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received unexpected event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with vm_state active and task_state deleting.
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:16 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Deleted allocations for instance e29684d3-c5fd-4336-abc3-5da416e300e2
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7424c296-8155-41f3-b766-4a25f263d6ce tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "e29684d3-c5fd-4336-abc3-5da416e300e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.981s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:17 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:17 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Took 2.21 seconds to deallocate network for instance.
Nov 21 14:27:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:18 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Deleted allocations for instance a76d5dda-a6c7-4e62-8471-16c8c99344da
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b404373d-7be8-4345-afc2-57eb5c58e724 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.778s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:18 user nova-compute[74882]: WARNING nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received unexpected event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with vm_state deleted and task_state None.
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-unplugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-unplugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:18 user nova-compute[74882]: WARNING nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received unexpected event network-vif-unplugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with vm_state deleted and task_state None.
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Acquiring lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] Lock "a76d5dda-a6c7-4e62-8471-16c8c99344da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] No waiting events found dispatching network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:18 user nova-compute[74882]: WARNING nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received unexpected event network-vif-plugged-ac3237ae-45f1-4e33-98c3-521fcbe48dde for instance with vm_state deleted and task_state None.
Nov 21 14:27:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc08abed-c1c4-4457-ba60-b762c8c5249a req-e73d3693-1c28-46a5-90cc-7af6796ebde3 service nova] [instance: a76d5dda-a6c7-4e62-8471-16c8c99344da] Received event network-vif-deleted-ac3237ae-45f1-4e33-98c3-521fcbe48dde {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:27:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKQtiVPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:27:19 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:27:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:27:20 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:27:20 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d997098-6bba-4a49-8f58-5af85b6a4360]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:27:20 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd92b54-e68d-4000-bb51-cb4fe91a71fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b] added
Nov 21 14:27:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1dfd5a-b943-4012-80c0-e97a267f49c4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f414b-e824-4568-b3da-c2d5610827c8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKQtiVPe {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hKQtiVPe" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d7f362-a7ff-4bac-b970-6f13a6640def]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hKQtiVPe'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f74688c-3b6c-47f1-84ab-7374650930df]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[465e575e-c027-4e76-98fa-efc050acdd81]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbb1582-87d9-47b5-adae-9dd472224f6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260]
Nov 21 14:27:20 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260] successful.
Nov 21 14:27:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea073fa9-4cef-4873-8328-c9bf7825ad1b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f1b4a6-da9d-4242-b3b8-9b445207e4bd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b (non-flash)
Nov 21 14:27:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:20 user nova-compute[74882]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b (non-flash)
Nov 21 14:27:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f113c140-a583-4bd7-b358-721ce94e62f2]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKQtiVPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:27:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26532616666313836', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532616666313836', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG nova.objects.instance [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:27:21 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:27:21 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:27:21 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:27:21 user nova-compute[74882]:   <serial>74f2bc96-8feb-411b-b075-6000893ad60b</serial>
Nov 21 14:27:21 user nova-compute[74882]: </disk>
Nov 21 14:27:21 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No VIF found with MAC fa:16:3e:c5:66:55, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:27:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9938ca36-3456-413b-9992-3858b4ea5356 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.857s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:27:33 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:27:33 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:27:33 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.304851531982422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Applying migration context for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 as it has an incoming, in-progress migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff. Migration status is finished {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 21 14:27:34 user nova-compute[74882]: INFO nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating resource usage from migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7892830a-13fc-48a2-bfd3-29a96b2a9113 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 4238ef1f-4d57-472f-b902-33aae507931b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:34 user nova-compute[74882]: INFO nova.compute.manager [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Terminating instance
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-25df4e70-286a-4366-943a-32bfab7b926d req-de8e204d-7c3a-42fe-b900-840053941f41 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-unplugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Instance destroyed successfully.
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'resources' on Instance uuid 7892830a-13fc-48a2-bfd3-29a96b2a9113 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-70492316',display_name='tempest-AttachVolumeTestJSON-server-70492316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-70492316',id=5,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyHwfqJ7OitBO37osr7boBaWdw1BXVnFOc65jFRrZhN3ZgYCQL6Cp23L0o7Iyy9XIZEqjrnhYMv6X6i6D2ARATcNP0WD3fOW51CoVyg7fkgL6iT7WxFa4uRyXncSprj1A==',key_name='tempest-keypair-1671638300',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-q6k0bdin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=7892830a-13fc-48a2-bfd3-29a96b2a9113,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "address": "fa:16:3e:5c:a6:7f", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf39421d4-14", "ovs_interfaceid": "f39421d4-14c9-470b-9aab-7c4b25deccd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG os_vif [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf39421d4-14, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d9c2e9c-5193-4b59-85ff-10e8307cfb14) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:34 user nova-compute[74882]: INFO os_vif [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a6:7f,bridge_name='br-int',has_traffic_filtering=True,id=f39421d4-14c9-470b-9aab-7c4b25deccd2,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf39421d4-14')
Nov 21 14:27:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Deleting instance files /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113_del
Nov 21 14:27:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Deletion of /opt/stack/data/nova/instances/7892830a-13fc-48a2-bfd3-29a96b2a9113_del complete
Nov 21 14:27:35 user nova-compute[74882]: INFO nova.compute.manager [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 21 14:27:35 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:27:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:36 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Took 1.25 seconds to deallocate network for instance.
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:36 user nova-compute[74882]: INFO nova.compute.manager [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Detaching volume 74f2bc96-8feb-411b-b075-6000893ad60b
Nov 21 14:27:36 user nova-compute[74882]: INFO nova.virt.block_device [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attempting to driver detach volume 74f2bc96-8feb-411b-b075-6000893ad60b from mountpoint /dev/vdb
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Attempting to detach device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:27:36 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:27:36 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:27:36 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:27:36 user nova-compute[74882]:   <serial>74f2bc96-8feb-411b-b075-6000893ad60b</serial>
Nov 21 14:27:36 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:27:36 user nova-compute[74882]: </disk>
Nov 21 14:27:36 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:27:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config.
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:27:36 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:27:36 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:27:36 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:27:36 user nova-compute[74882]:   <serial>74f2bc96-8feb-411b-b075-6000893ad60b</serial>
Nov 21 14:27:36 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:27:36 user nova-compute[74882]: </disk>
Nov 21 14:27:36 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:36 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Deleted allocations for instance 7892830a-13fc-48a2-bfd3-29a96b2a9113
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Acquiring lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] No waiting events found dispatching network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:36 user nova-compute[74882]: WARNING nova.compute.manager [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received unexpected event network-vif-plugged-f39421d4-14c9-470b-9aab-7c4b25deccd2 for instance with vm_state deleted and task_state None.
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-aa74af09-d0ee-4f13-a5a2-ff1f442faed9 req-52d8f314-5350-48f7-9da4-42e18ddfb312 service nova] [instance: 7892830a-13fc-48a2-bfd3-29a96b2a9113] Received event network-vif-deleted-f39421d4-14c9-470b-9aab-7c4b25deccd2 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2665d514-7b51-43e5-896b-8209c312a858 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "7892830a-13fc-48a2-bfd3-29a96b2a9113" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:27:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:27:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:27:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:27:37 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:27:38 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updating instance_info_cache with network_info: [{"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:27:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-4238ef1f-4d57-472f-b902-33aae507931b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:27:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:27:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:27:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:27:56 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 is timed out.
Nov 21 14:27:56 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config.
Nov 21 14:27:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:27:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hKQtiVPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:27:56 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:27:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:27:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:27:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e590a0-8b21-4b01-a139-f1048f05a6dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:27:57 user nova-compute[74882]: No targets found.
Nov 21 14:27:57 user nova-compute[74882]: iSNS:
Nov 21 14:27:57 user nova-compute[74882]: No targets found.
Nov 21 14:27:57 user nova-compute[74882]: STATIC:
Nov 21 14:27:57 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:27:57 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:27:57 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:27:57 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:27:57 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:27:57 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:27:57 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b
Nov 21 14:27:57 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:27:57 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:27:57 user nova-compute[74882]: FIRMWARE:
Nov 21 14:27:57 user nova-compute[74882]: No targets found.
Nov 21 14:27:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:27:57 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:27:57 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f88e8-c0e2-44a1-bed2-64df69805a6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dc5a99-3eaa-447e-8d35-254822199134]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:57 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:57 user nova-compute[74882]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b (non-flash)
Nov 21 14:27:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:27:57 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:27:57 user nova-compute[74882]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b (non-flash)
Nov 21 14:27:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c462170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[52be4990-4279-4972-bdf8-43637b21c25d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5149294b-4c48-4d6b-b8b2-6a6d6bd6f26d]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[35423e62-98df-49d4-94e2-ef189861bd91]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a8abd0-2b0d-4326-a93b-5d4a0a635524]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e70f072-d29b-483d-8809-0de5b392d7ae]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae25cbb-4bd0-4f28-8c75-50034b5ea946]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260]
Nov 21 14:27:57 user nova-compute[74882]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b, portal: 172.16.0.220,3260] successful.
Nov 21 14:27:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74f2bc96-8feb-411b-b075-6000893ad60b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.144s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4867eb99-3618-4ff0-b7da-779b3be5065f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== disconnect_volume: return (449ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:27:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:27:58 user nova-compute[74882]: DEBUG nova.objects.instance [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:27:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-666fc466-db4f-4267-b529-d525a145f355 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.814s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:59 user nova-compute[74882]: INFO nova.compute.manager [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Terminating instance
Nov 21 14:27:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-vif-unplugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] No waiting events found dispatching network-vif-unplugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-f94a70e7-26eb-49d4-8e23-48e61a6b965b req-fe78964c-ca80-43f6-ae36-f393faaaa98c service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-vif-unplugged-a9efa405-53bc-47b6-831c-8bae5302754f for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:27:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Instance destroyed successfully.
Nov 21 14:28:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lazy-loading 'resources' on Instance uuid 4238ef1f-4d57-472f-b902-33aae507931b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-926413379',display_name='tempest-VolumesAdminNegativeTest-server-926413379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-926413379',id=16,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIgtT9MPdGsRerkoAmYBJprp9EZkPrFi/Tb9V24DN84MmkyPsD+E5nrKgRf83VTJ0tWnfZvruXA2QsHcBiuOnJInoeUVnqKKOtMOWNdnF/4teCiXe3ULO+8JRSuIQOh6A==',key_name='tempest-keypair-829674788',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:22:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a26cdaa13ed94137bcb577358a2054dc',ramdisk_id='',reservation_id='r-4k30ujdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-564618194',owner_user_name='tempest-VolumesAdminNegativeTest-564618194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85844a0bfabd4095b647684ad7a1003a',uuid=4238ef1f-4d57-472f-b902-33aae507931b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converting VIF {"id": "a9efa405-53bc-47b6-831c-8bae5302754f", "address": "fa:16:3e:7d:39:26", "network": {"id": "339e70be-6083-486f-b6a2-097ee63ca3e4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-897785717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a26cdaa13ed94137bcb577358a2054dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9efa405-53", "ovs_interfaceid": "a9efa405-53bc-47b6-831c-8bae5302754f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:39:26,bridge_name='br-int',has_traffic_filtering=True,id=a9efa405-53bc-47b6-831c-8bae5302754f,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9efa405-53') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG os_vif [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:39:26,bridge_name='br-int',has_traffic_filtering=True,id=a9efa405-53bc-47b6-831c-8bae5302754f,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9efa405-53') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9efa405-53, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11825208-c16d-43b9-b57c-ff0d4eea1aac) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:00 user nova-compute[74882]: INFO os_vif [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:39:26,bridge_name='br-int',has_traffic_filtering=True,id=a9efa405-53bc-47b6-831c-8bae5302754f,network=Network(339e70be-6083-486f-b6a2-097ee63ca3e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9efa405-53')
Nov 21 14:28:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Deleting instance files /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b_del
Nov 21 14:28:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Deletion of /opt/stack/data/nova/instances/4238ef1f-4d57-472f-b902-33aae507931b_del complete
Nov 21 14:28:00 user nova-compute[74882]: INFO nova.compute.manager [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 21 14:28:00 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:28:00 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:01 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Took 0.91 seconds to deallocate network for instance.
Nov 21 14:28:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-1e588235-9674-4a6f-a24a-a3b07285f408 req-38957e3b-183d-45f3-a09f-2068852ad21b service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-vif-deleted-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:01 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Deleted allocations for instance 4238ef1f-4d57-472f-b902-33aae507931b
Nov 21 14:28:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f85a1b2f-e51f-4df5-a1dc-aa7f0b470a12 tempest-VolumesAdminNegativeTest-564618194 tempest-VolumesAdminNegativeTest-564618194-project-member] Lock "4238ef1f-4d57-472f-b902-33aae507931b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received event network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Acquiring lock "4238ef1f-4d57-472f-b902-33aae507931b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] Lock "4238ef1f-4d57-472f-b902-33aae507931b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] No waiting events found dispatching network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:01 user nova-compute[74882]: WARNING nova.compute.manager [req-3f26da08-3050-407d-bef1-c132cffe9ae9 req-fa10aa14-3a8d-4040-8fca-3d9ec651f4a1 service nova] [instance: 4238ef1f-4d57-472f-b902-33aae507931b] Received unexpected event network-vif-plugged-a9efa405-53bc-47b6-831c-8bae5302754f for instance with vm_state deleted and task_state None.
Nov 21 14:28:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:28:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:28:08 user nova-compute[74882]: INFO nova.compute.claims [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Claim successful on node user
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:28:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.policy [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd55abe8426b34d10b31ff6b0aefddd37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dadaa9830cd54eb09daee40d952be38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:28:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Creating image(s)
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "/opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk 1073741824" returned: 0 in 0.052s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.219s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Cannot resize image /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Ensure instance console log exists: /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Successfully created port: a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Successfully updated port: a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquired lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-changed-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Refreshing instance network info cache due to event network-changed-a2e47e55-e8fc-4acc-94b2-affe7175312f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Acquiring lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updating instance_info_cache with network_info: [{"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Releasing lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Instance network_info: |[{"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Acquired lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Refreshing network info cache for port a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Start _get_guest_xml network_info=[{"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:28:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273719294',display_name='tempest-AttachVolumeNegativeTest-server-273719294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-273719294',id=24,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LK5wibZIOBbPogA8ShMLJsBp29tS9U/yH2c8rOMZPif+igCe47OOPKt9Q4MqgvofUlhEeB2RyAkIQVGobhUH7J4eg1rL+SoPrAdzSsdyoiGkMsQuAbudPcqZMW8sr3w==',key_name='tempest-keypair-740459586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-joqfkbm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=d61339ed-84db-4f60-8d64-292749322a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=a2e47e55-e8fc-4acc-94b2-affe7175312f,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e47e55-e8') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.objects.instance [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'pci_devices' on Instance uuid d61339ed-84db-4f60-8d64-292749322a77 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:28:11 user nova-compute[74882]:   <uuid>d61339ed-84db-4f60-8d64-292749322a77</uuid>
Nov 21 14:28:11 user nova-compute[74882]:   <name>instance-00000018</name>
Nov 21 14:28:11 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:28:11 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:28:11 user nova-compute[74882]:   <metadata>
Nov 21 14:28:11 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:28:11 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:28:11 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeNegativeTest-server-273719294</nova:name>
Nov 21 14:28:11 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:28:11</nova:creationTime>
Nov 21 14:28:11 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:28:11 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:28:11 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:28:11 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:28:11 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:28:11 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:28:11 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:28:11 user nova-compute[74882]:       <nova:owner>
Nov 21 14:28:11 user nova-compute[74882]:         <nova:user uuid="d55abe8426b34d10b31ff6b0aefddd37">tempest-AttachVolumeNegativeTest-1777808809-project-member</nova:user>
Nov 21 14:28:11 user nova-compute[74882]:         <nova:project uuid="dadaa9830cd54eb09daee40d952be38f">tempest-AttachVolumeNegativeTest-1777808809</nova:project>
Nov 21 14:28:11 user nova-compute[74882]:       </nova:owner>
Nov 21 14:28:11 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:28:11 user nova-compute[74882]:       <nova:ports>
Nov 21 14:28:11 user nova-compute[74882]:         <nova:port uuid="a2e47e55-e8fc-4acc-94b2-affe7175312f">
Nov 21 14:28:11 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:28:11 user nova-compute[74882]:         </nova:port>
Nov 21 14:28:11 user nova-compute[74882]:       </nova:ports>
Nov 21 14:28:11 user nova-compute[74882]:     </nova:instance>
Nov 21 14:28:11 user nova-compute[74882]:   </metadata>
Nov 21 14:28:11 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:28:11 user nova-compute[74882]:     <system>
Nov 21 14:28:11 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:28:11 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:28:11 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:28:11 user nova-compute[74882]:       <entry name="serial">d61339ed-84db-4f60-8d64-292749322a77</entry>
Nov 21 14:28:11 user nova-compute[74882]:       <entry name="uuid">d61339ed-84db-4f60-8d64-292749322a77</entry>
Nov 21 14:28:11 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:28:11 user nova-compute[74882]:     </system>
Nov 21 14:28:11 user nova-compute[74882]:   </sysinfo>
Nov 21 14:28:11 user nova-compute[74882]:   <os>
Nov 21 14:28:11 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:28:11 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:28:11 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:28:11 user nova-compute[74882]:   </os>
Nov 21 14:28:11 user nova-compute[74882]:   <features>
Nov 21 14:28:11 user nova-compute[74882]:     <acpi/>
Nov 21 14:28:11 user nova-compute[74882]:     <apic/>
Nov 21 14:28:11 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:28:11 user nova-compute[74882]:   </features>
Nov 21 14:28:11 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:28:11 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:28:11 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:28:11 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:28:11 user nova-compute[74882]:   </clock>
Nov 21 14:28:11 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:28:11 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:28:11 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:28:11 user nova-compute[74882]:   </cpu>
Nov 21 14:28:11 user nova-compute[74882]:   <devices>
Nov 21 14:28:11 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:28:11 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:28:11 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk"/>
Nov 21 14:28:11 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:28:11 user nova-compute[74882]:     </disk>
Nov 21 14:28:11 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:28:11 user nova-compute[74882]:       <mac address="fa:16:3e:d6:8e:52"/>
Nov 21 14:28:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:11 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:28:11 user nova-compute[74882]:       <target dev="tapa2e47e55-e8"/>
Nov 21 14:28:11 user nova-compute[74882]:     </interface>
Nov 21 14:28:11 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:28:11 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/console.log" append="off"/>
Nov 21 14:28:11 user nova-compute[74882]:     </serial>
Nov 21 14:28:11 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:28:11 user nova-compute[74882]:     <video>
Nov 21 14:28:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:11 user nova-compute[74882]:     </video>
Nov 21 14:28:11 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:28:11 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:28:11 user nova-compute[74882]:     </rng>
Nov 21 14:28:11 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:28:11 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:28:11 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:28:11 user nova-compute[74882]:     </memballoon>
Nov 21 14:28:11 user nova-compute[74882]:   </devices>
Nov 21 14:28:11 user nova-compute[74882]: </domain>
Nov 21 14:28:11 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273719294',display_name='tempest-AttachVolumeNegativeTest-server-273719294',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-273719294',id=24,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LK5wibZIOBbPogA8ShMLJsBp29tS9U/yH2c8rOMZPif+igCe47OOPKt9Q4MqgvofUlhEeB2RyAkIQVGobhUH7J4eg1rL+SoPrAdzSsdyoiGkMsQuAbudPcqZMW8sr3w==',key_name='tempest-keypair-740459586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-joqfkbm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=d61339ed-84db-4f60-8d64-292749322a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=a2e47e55-e8fc-4acc-94b2-affe7175312f,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e47e55-e8') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG os_vif [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=a2e47e55-e8fc-4acc-94b2-affe7175312f,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e47e55-e8') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e67ca62-6295-5d6e-a62d-eca7c828c82c', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2e47e55-e8, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2e47e55-e8, col_values=(('qos', UUID('977eea50-dbe1-431f-960d-8d0fbc220f23')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2e47e55-e8, col_values=(('external_ids', {'iface-id': 'a2e47e55-e8fc-4acc-94b2-affe7175312f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:8e:52', 'vm-uuid': 'd61339ed-84db-4f60-8d64-292749322a77'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:11 user nova-compute[74882]: INFO os_vif [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=a2e47e55-e8fc-4acc-94b2-affe7175312f,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e47e55-e8')
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No VIF found with MAC fa:16:3e:d6:8e:52, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updated VIF entry in instance network info cache for port a2e47e55-e8fc-4acc-94b2-affe7175312f. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updating instance_info_cache with network_info: [{"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7fc534cc-7010-4070-8779-7f4ebf039838 req-56e6cab3-6433-48ce-986a-cd07f9c91496 service nova] Releasing lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] No waiting events found dispatching network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:13 user nova-compute[74882]: WARNING nova.compute.manager [req-ae37a23b-4a89-4af6-975a-47b2d75f53c7 req-9be335d1-14c5-4a96-ab27-2d15047be2b7 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received unexpected event network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f for instance with vm_state building and task_state spawning.
Nov 21 14:28:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] No waiting events found dispatching network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:15 user nova-compute[74882]: WARNING nova.compute.manager [req-b14e9284-b619-4f10-82d3-933928a85d23 req-ab4a55eb-8343-4b31-8f7b-528ac374e77d service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received unexpected event network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f for instance with vm_state building and task_state spawning.
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:28:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: d61339ed-84db-4f60-8d64-292749322a77] Instance spawned successfully.
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:15 user nova-compute[74882]: INFO nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 21 14:28:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:28:15 user nova-compute[74882]: INFO nova.compute.manager [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Took 6.79 seconds to build instance.
Nov 21 14:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-5210b006-511f-40c4-9f08-b494244511ba tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.889s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:28 user nova-compute[74882]: INFO nova.compute.manager [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attaching volume 13cbcfe3-a17f-4e37-afd6-47e28eed9d90 to /dev/vdb
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:28:28 user nova-compute[74882]: INFO nova.compute.claims [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Claim successful on node user
Nov 21 14:28:28 user nova-compute[74882]: DEBUG os_brick.utils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[944b07db-be1c-4f2c-8cc9-e61a88b853e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee784afb-26fc-452c-aacb-d4a338b6a620]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d523eb5-c657-4e01-875e-70ab8e6304a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68bf00f-66f1-4f5c-b852-d7e3c1a90286]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:28:29 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aef0f3-a7f0-4aa3-a2f4-1dac234eb302]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG os_brick.utils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== get_connector_properties: return (223ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating existing volume attachment record: 88389007-8e1b-4a2e-9479-10e603d60f4d {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:28:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:28:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Creating image(s)
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "/opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "/opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:29 user nova-compute[74882]: DEBUG nova.policy [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0cb90d4bdf74f9390124833ea8331bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '894802e2e3d044199467be931dd8e036', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk 1073741824" returned: 0 in 0.053s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Cannot resize image /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Ensure instance console log exists: /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Successfully created port: b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:28:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Successfully updated port: b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquired lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-changed-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Refreshing instance network info cache due to event network-changed-b08c806e-bd8a-4ff2-9e57-7e282ee74121. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Acquiring lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updating instance_info_cache with network_info: [{"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Releasing lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Instance network_info: |[{"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Acquired lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Refreshing network info cache for port b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Start _get_guest_xml network_info=[{"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:28:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666390476',display_name='tempest-AttachVolumeTestJSON-server-666390476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666390476',id=25,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdfjBdUaeg5gBMzRCIC2CLsKPZxcHOKYD5qYtqN1/wF9/M2H5BGBIvefGyVawGV2+mQ5eBpSZ0rozkc8ojAdQgF74dQtDNJ6Q333DFnreFkyQAnkBfUkLkWnCnqPtz+Tg==',key_name='tempest-keypair-1711900749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-ihkrbyin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b08c806e-bd8a-4ff2-9e57-7e282ee74121,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08c806e-bd') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'pci_devices' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:28:32 user nova-compute[74882]:   <uuid>bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1</uuid>
Nov 21 14:28:32 user nova-compute[74882]:   <name>instance-00000019</name>
Nov 21 14:28:32 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:28:32 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:28:32 user nova-compute[74882]:   <metadata>
Nov 21 14:28:32 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:28:32 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:28:32 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeTestJSON-server-666390476</nova:name>
Nov 21 14:28:32 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:28:32</nova:creationTime>
Nov 21 14:28:32 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:28:32 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:28:32 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:28:32 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:28:32 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:28:32 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:28:32 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:28:32 user nova-compute[74882]:       <nova:owner>
Nov 21 14:28:32 user nova-compute[74882]:         <nova:user uuid="c0cb90d4bdf74f9390124833ea8331bd">tempest-AttachVolumeTestJSON-1610644153-project-member</nova:user>
Nov 21 14:28:32 user nova-compute[74882]:         <nova:project uuid="894802e2e3d044199467be931dd8e036">tempest-AttachVolumeTestJSON-1610644153</nova:project>
Nov 21 14:28:32 user nova-compute[74882]:       </nova:owner>
Nov 21 14:28:32 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:28:32 user nova-compute[74882]:       <nova:ports>
Nov 21 14:28:32 user nova-compute[74882]:         <nova:port uuid="b08c806e-bd8a-4ff2-9e57-7e282ee74121">
Nov 21 14:28:32 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 14:28:32 user nova-compute[74882]:         </nova:port>
Nov 21 14:28:32 user nova-compute[74882]:       </nova:ports>
Nov 21 14:28:32 user nova-compute[74882]:     </nova:instance>
Nov 21 14:28:32 user nova-compute[74882]:   </metadata>
Nov 21 14:28:32 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:28:32 user nova-compute[74882]:     <system>
Nov 21 14:28:32 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:28:32 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:28:32 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:28:32 user nova-compute[74882]:       <entry name="serial">bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1</entry>
Nov 21 14:28:32 user nova-compute[74882]:       <entry name="uuid">bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1</entry>
Nov 21 14:28:32 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:28:32 user nova-compute[74882]:     </system>
Nov 21 14:28:32 user nova-compute[74882]:   </sysinfo>
Nov 21 14:28:32 user nova-compute[74882]:   <os>
Nov 21 14:28:32 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:28:32 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:28:32 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:28:32 user nova-compute[74882]:   </os>
Nov 21 14:28:32 user nova-compute[74882]:   <features>
Nov 21 14:28:32 user nova-compute[74882]:     <acpi/>
Nov 21 14:28:32 user nova-compute[74882]:     <apic/>
Nov 21 14:28:32 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:28:32 user nova-compute[74882]:   </features>
Nov 21 14:28:32 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:28:32 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:28:32 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:28:32 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:28:32 user nova-compute[74882]:   </clock>
Nov 21 14:28:32 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:28:32 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:28:32 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:28:32 user nova-compute[74882]:   </cpu>
Nov 21 14:28:32 user nova-compute[74882]:   <devices>
Nov 21 14:28:32 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:28:32 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:28:32 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk"/>
Nov 21 14:28:32 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:28:32 user nova-compute[74882]:     </disk>
Nov 21 14:28:32 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:28:32 user nova-compute[74882]:       <mac address="fa:16:3e:ae:e1:17"/>
Nov 21 14:28:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:32 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:28:32 user nova-compute[74882]:       <target dev="tapb08c806e-bd"/>
Nov 21 14:28:32 user nova-compute[74882]:     </interface>
Nov 21 14:28:32 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:28:32 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/console.log" append="off"/>
Nov 21 14:28:32 user nova-compute[74882]:     </serial>
Nov 21 14:28:32 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:28:32 user nova-compute[74882]:     <video>
Nov 21 14:28:32 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:32 user nova-compute[74882]:     </video>
Nov 21 14:28:32 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:28:32 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:28:32 user nova-compute[74882]:     </rng>
Nov 21 14:28:32 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:28:32 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:28:32 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:28:32 user nova-compute[74882]:     </memballoon>
Nov 21 14:28:32 user nova-compute[74882]:   </devices>
Nov 21 14:28:32 user nova-compute[74882]: </domain>
Nov 21 14:28:32 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666390476',display_name='tempest-AttachVolumeTestJSON-server-666390476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666390476',id=25,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdfjBdUaeg5gBMzRCIC2CLsKPZxcHOKYD5qYtqN1/wF9/M2H5BGBIvefGyVawGV2+mQ5eBpSZ0rozkc8ojAdQgF74dQtDNJ6Q333DFnreFkyQAnkBfUkLkWnCnqPtz+Tg==',key_name='tempest-keypair-1711900749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-ihkrbyin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b08c806e-bd8a-4ff2-9e57-7e282ee74121,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08c806e-bd') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG os_vif [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b08c806e-bd8a-4ff2-9e57-7e282ee74121,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08c806e-bd') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0568afd4-c420-5bb4-a3fc-b5a065552b7f', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb08c806e-bd, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb08c806e-bd, col_values=(('qos', UUID('9e8e8b13-9d88-49be-815c-f880ae7e076e')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb08c806e-bd, col_values=(('external_ids', {'iface-id': 'b08c806e-bd8a-4ff2-9e57-7e282ee74121', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:e1:17', 'vm-uuid': 'bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:32 user nova-compute[74882]: INFO os_vif [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b08c806e-bd8a-4ff2-9e57-7e282ee74121,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08c806e-bd')
Nov 21 14:28:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:28:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No VIF found with MAC fa:16:3e:ae:e1:17, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updated VIF entry in instance network info cache for port b08c806e-bd8a-4ff2-9e57-7e282ee74121. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updating instance_info_cache with network_info: [{"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6520302c-5a69-476b-b027-45c41df1e23b req-4219e545-b531-4532-b84e-7b8503f4851a service nova] Releasing lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] No waiting events found dispatching network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:34 user nova-compute[74882]: WARNING nova.compute.manager [req-3e7fe277-c211-406c-bd28-3464664a1b48 req-72d6c216-fa8c-4fd1-a558-5a020e1e5e9b service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received unexpected event network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance with vm_state building and task_state spawning.
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] No waiting events found dispatching network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:36 user nova-compute[74882]: WARNING nova.compute.manager [req-c0069586-2437-4231-855a-fdbe62fdb393 req-3c8d1cea-42cf-4bac-8696-a918323f5724 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received unexpected event network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance with vm_state building and task_state spawning.
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPpQKfWx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:28:36 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:28:36 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:28:36 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:36 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:36 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7941MB free_disk=25.319408416748047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Instance spawned successfully.
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea01790-4783-4b5f-87e4-dbc3c73a79d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:28:36 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1a9d03-253c-4549-808b-bdbb87f6338d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90] added
Nov 21 14:28:36 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7967a466-0968-4661-83d0-2b32d02b1f15]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9147a1af-4f38-40a0-afee-2f933d127c01]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPpQKfWx {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Applying migration context for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 as it has an incoming, in-progress migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff. Migration status is finished {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 21 14:28:37 user nova-compute[74882]: INFO nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating resource usage from migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff
Nov 21 14:28:37 user nova-compute[74882]: INFO nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Took 7.41 seconds to spawn the instance on the hypervisor.
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPpQKfWx" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa8085-b25a-48b9-9d49-a1449a324955]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPpQKfWx'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance d61339ed-84db-4f60-8d64-292749322a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[95237445-13ad-404f-82c5-e7e7c1b62065]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2799b4-dff3-47fa-9b08-8737032fdd7c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: INFO nova.compute.manager [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Took 8.38 seconds to build instance.
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fa59f2-c1ba-43c4-9d18-3f2d3b3e113f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260]
Nov 21 14:28:37 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260] successful.
Nov 21 14:28:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6fbc06e6-1479-4471-9e8e-1ce9985f4be2 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.510s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72d824c-9805-4d56-b9af-4719994445b3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d433f0c-00ac-4332-b349-a23a86eab20b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3e112a-1841-43b9-bc19-0db155828ae9]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "24342449-c859-4f3d-a215-4f1930a612b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "24342449-c859-4f3d-a215-4f1930a612b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:28:38 user nova-compute[74882]: INFO nova.compute.claims [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Claim successful on node user
Nov 21 14:28:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPpQKfWx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23230666631336635', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230666631336635', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.objects.instance [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:28:38 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:28:38 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:28:38 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:28:38 user nova-compute[74882]:   <serial>13cbcfe3-a17f-4e37-afd6-47e28eed9d90</serial>
Nov 21 14:28:38 user nova-compute[74882]: </disk>
Nov 21 14:28:38 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.network.neutron [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:28:38 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No VIF found with MAC fa:16:3e:c5:66:55, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:28:38 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Creating image(s)
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "/opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "/opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "/opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.policy [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e026bd9694a247cdab93467d43b9f57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357e5035226846ffac018b95ba6a9853', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-722f64b1-8144-471c-a660-119af2703086 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.323s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updating instance_info_cache with network_info: [{"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk 1073741824" returned: 0 in 0.073s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.network.neutron [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Successfully created port: c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Cannot resize image /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Ensure instance console log exists: /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "8982cace-751d-41d6-9131-561f6b55ca54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "8982cace-751d-41d6-9131-561f6b55ca54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:28:40 user nova-compute[74882]: INFO nova.compute.claims [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Claim successful on node user
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Successfully updated port: c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "refresh_cache-24342449-c859-4f3d-a215-4f1930a612b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquired lock "refresh_cache-24342449-c859-4f3d-a215-4f1930a612b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received event network-changed-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Refreshing instance network info cache due to event network-changed-c0918391-3bbd-4d9a-9ffe-e5eb3402554f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Acquiring lock "refresh_cache-24342449-c859-4f3d-a215-4f1930a612b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:40 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.policy [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:28:40 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Creating image(s)
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "/opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "/opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "/opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Updating instance_info_cache with network_info: [{"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Releasing lock "refresh_cache-24342449-c859-4f3d-a215-4f1930a612b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Instance network_info: |[{"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Acquired lock "refresh_cache-24342449-c859-4f3d-a215-4f1930a612b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.neutron [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Refreshing network info cache for port c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Start _get_guest_xml network_info=[{"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:28:41 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:41 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1394546310',display_name='tempest-VolumesNegativeTest-instance-1394546310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1394546310',id=26,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='357e5035226846ffac018b95ba6a9853',ramdisk_id='',reservation_id='r-b7zo3wtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1253096034',owner_user_name='tempest-VolumesNegativeTest-1253096034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:39Z,user_data=None,user_id='e026bd9694a247cdab93467d43b9f57b',uuid=24342449-c859-4f3d-a215-4f1930a612b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Converting VIF {"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d3:c9,bridge_name='br-int',has_traffic_filtering=True,id=c0918391-3bbd-4d9a-9ffe-e5eb3402554f,network=Network(17e1fb9e-1064-4618-99d2-831fb9cd6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0918391-3b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.objects.instance [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lazy-loading 'pci_devices' on Instance uuid 24342449-c859-4f3d-a215-4f1930a612b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:28:41 user nova-compute[74882]:   <uuid>24342449-c859-4f3d-a215-4f1930a612b9</uuid>
Nov 21 14:28:41 user nova-compute[74882]:   <name>instance-0000001a</name>
Nov 21 14:28:41 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:28:41 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:28:41 user nova-compute[74882]:   <metadata>
Nov 21 14:28:41 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:28:41 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:28:41 user nova-compute[74882]:       <nova:name>tempest-VolumesNegativeTest-instance-1394546310</nova:name>
Nov 21 14:28:41 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:28:41</nova:creationTime>
Nov 21 14:28:41 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:28:41 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:28:41 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:28:41 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:28:41 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:28:41 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:28:41 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:28:41 user nova-compute[74882]:       <nova:owner>
Nov 21 14:28:41 user nova-compute[74882]:         <nova:user uuid="e026bd9694a247cdab93467d43b9f57b">tempest-VolumesNegativeTest-1253096034-project-member</nova:user>
Nov 21 14:28:41 user nova-compute[74882]:         <nova:project uuid="357e5035226846ffac018b95ba6a9853">tempest-VolumesNegativeTest-1253096034</nova:project>
Nov 21 14:28:41 user nova-compute[74882]:       </nova:owner>
Nov 21 14:28:41 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:28:41 user nova-compute[74882]:       <nova:ports>
Nov 21 14:28:41 user nova-compute[74882]:         <nova:port uuid="c0918391-3bbd-4d9a-9ffe-e5eb3402554f">
Nov 21 14:28:41 user nova-compute[74882]:           <nova:ip type="fixed" address="192.168.233.152" ipVersion="4"/>
Nov 21 14:28:41 user nova-compute[74882]:         </nova:port>
Nov 21 14:28:41 user nova-compute[74882]:       </nova:ports>
Nov 21 14:28:41 user nova-compute[74882]:     </nova:instance>
Nov 21 14:28:41 user nova-compute[74882]:   </metadata>
Nov 21 14:28:41 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:28:41 user nova-compute[74882]:     <system>
Nov 21 14:28:41 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:28:41 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:28:41 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:28:41 user nova-compute[74882]:       <entry name="serial">24342449-c859-4f3d-a215-4f1930a612b9</entry>
Nov 21 14:28:41 user nova-compute[74882]:       <entry name="uuid">24342449-c859-4f3d-a215-4f1930a612b9</entry>
Nov 21 14:28:41 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:28:41 user nova-compute[74882]:     </system>
Nov 21 14:28:41 user nova-compute[74882]:   </sysinfo>
Nov 21 14:28:41 user nova-compute[74882]:   <os>
Nov 21 14:28:41 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:28:41 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:28:41 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:28:41 user nova-compute[74882]:   </os>
Nov 21 14:28:41 user nova-compute[74882]:   <features>
Nov 21 14:28:41 user nova-compute[74882]:     <acpi/>
Nov 21 14:28:41 user nova-compute[74882]:     <apic/>
Nov 21 14:28:41 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:28:41 user nova-compute[74882]:   </features>
Nov 21 14:28:41 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:28:41 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:28:41 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:28:41 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:28:41 user nova-compute[74882]:   </clock>
Nov 21 14:28:41 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:28:41 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:28:41 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:28:41 user nova-compute[74882]:   </cpu>
Nov 21 14:28:41 user nova-compute[74882]:   <devices>
Nov 21 14:28:41 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:28:41 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:28:41 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk"/>
Nov 21 14:28:41 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:28:41 user nova-compute[74882]:     </disk>
Nov 21 14:28:41 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:28:41 user nova-compute[74882]:       <mac address="fa:16:3e:94:d3:c9"/>
Nov 21 14:28:41 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:41 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:28:41 user nova-compute[74882]:       <target dev="tapc0918391-3b"/>
Nov 21 14:28:41 user nova-compute[74882]:     </interface>
Nov 21 14:28:41 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:28:41 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/console.log" append="off"/>
Nov 21 14:28:41 user nova-compute[74882]:     </serial>
Nov 21 14:28:41 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:28:41 user nova-compute[74882]:     <video>
Nov 21 14:28:41 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:41 user nova-compute[74882]:     </video>
Nov 21 14:28:41 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:28:41 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:28:41 user nova-compute[74882]:     </rng>
Nov 21 14:28:41 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:28:41 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:28:41 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:28:41 user nova-compute[74882]:     </memballoon>
Nov 21 14:28:41 user nova-compute[74882]:   </devices>
Nov 21 14:28:41 user nova-compute[74882]: </domain>
Nov 21 14:28:41 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1394546310',display_name='tempest-VolumesNegativeTest-instance-1394546310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1394546310',id=26,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='357e5035226846ffac018b95ba6a9853',ramdisk_id='',reservation_id='r-b7zo3wtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1253096034',owner_user_name='tempest-VolumesNegativeTest-1253096034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:39Z,user_data=None,user_id='e026bd9694a247cdab93467d43b9f57b',uuid=24342449-c859-4f3d-a215-4f1930a612b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Converting VIF {"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d3:c9,bridge_name='br-int',has_traffic_filtering=True,id=c0918391-3bbd-4d9a-9ffe-e5eb3402554f,network=Network(17e1fb9e-1064-4618-99d2-831fb9cd6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0918391-3b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG os_vif [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d3:c9,bridge_name='br-int',has_traffic_filtering=True,id=c0918391-3bbd-4d9a-9ffe-e5eb3402554f,network=Network(17e1fb9e-1064-4618-99d2-831fb9cd6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0918391-3b') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47ed4a99-4ed5-57a8-b375-3fc3ab76c8f6', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0918391-3b, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0918391-3b, col_values=(('qos', UUID('7c5469ef-07cf-47fc-959d-cae180afd35c')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0918391-3b, col_values=(('external_ids', {'iface-id': 'c0918391-3bbd-4d9a-9ffe-e5eb3402554f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:d3:c9', 'vm-uuid': '24342449-c859-4f3d-a215-4f1930a612b9'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:41 user nova-compute[74882]: INFO os_vif [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d3:c9,bridge_name='br-int',has_traffic_filtering=True,id=c0918391-3bbd-4d9a-9ffe-e5eb3402554f,network=Network(17e1fb9e-1064-4618-99d2-831fb9cd6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0918391-3b')
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.211s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] No VIF found with MAC fa:16:3e:94:d3:c9, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk 1073741824" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.388s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Successfully created port: 630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.neutron [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Updated VIF entry in instance network info cache for port c0918391-3bbd-4d9a-9ffe-e5eb3402554f. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.network.neutron [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Updating instance_info_cache with network_info: [{"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.230s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-188a736c-e1db-4a73-9c67-66ed64e50108 req-88aadae9-f30d-41a8-b6ad-caa508138da8 service nova] Releasing lock "refresh_cache-24342449-c859-4f3d-a215-4f1930a612b9" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:41 user nova-compute[74882]: INFO nova.compute.manager [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Detaching volume 13cbcfe3-a17f-4e37-afd6-47e28eed9d90
Nov 21 14:28:41 user nova-compute[74882]: INFO nova.virt.block_device [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attempting to driver detach volume 13cbcfe3-a17f-4e37-afd6-47e28eed9d90 from mountpoint /dev/vdb
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Attempting to detach device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:28:41 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:28:41 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:28:41 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:28:41 user nova-compute[74882]:   <serial>13cbcfe3-a17f-4e37-afd6-47e28eed9d90</serial>
Nov 21 14:28:41 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:28:41 user nova-compute[74882]: </disk>
Nov 21 14:28:41 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:28:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config.
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:28:41 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:28:41 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:28:41 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:28:41 user nova-compute[74882]:   <serial>13cbcfe3-a17f-4e37-afd6-47e28eed9d90</serial>
Nov 21 14:28:41 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:28:41 user nova-compute[74882]: </disk>
Nov 21 14:28:41 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Cannot resize image /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Ensure instance console log exists: /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Successfully updated port: 630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "refresh_cache-8982cace-751d-41d6-9131-561f6b55ca54" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquired lock "refresh_cache-8982cace-751d-41d6-9131-561f6b55ca54" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.compute.manager [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received event network-changed-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.compute.manager [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Refreshing instance network info cache due to event network-changed-630cdcfd-f631-4d1b-8d7d-a0706074f1bb. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Acquiring lock "refresh_cache-8982cace-751d-41d6-9131-561f6b55ca54" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Updating instance_info_cache with network_info: [{"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Releasing lock "refresh_cache-8982cace-751d-41d6-9131-561f6b55ca54" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Instance network_info: |[{"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Acquired lock "refresh_cache-8982cace-751d-41d6-9131-561f6b55ca54" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.neutron [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Refreshing network info cache for port 630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Start _get_guest_xml network_info=[{"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:28:42 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:42 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1129360862',display_name='tempest-VolumesActionsTest-instance-1129360862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1129360862',id=27,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a42118796db243d7a72988931f9915fc',ramdisk_id='',reservation_id='r-7ifgx8hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1401937880',owner_user_name='tempest-VolumesActionsTest-1401937880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:41Z,user_data=None,user_id='a95c719f033946038ed21c53704577b1',uuid=8982cace-751d-41d6-9131-561f6b55ca54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converting VIF {"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:8f,bridge_name='br-int',has_traffic_filtering=True,id=630cdcfd-f631-4d1b-8d7d-a0706074f1bb,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630cdcfd-f6') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lazy-loading 'pci_devices' on Instance uuid 8982cace-751d-41d6-9131-561f6b55ca54 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:28:42 user nova-compute[74882]:   <uuid>8982cace-751d-41d6-9131-561f6b55ca54</uuid>
Nov 21 14:28:42 user nova-compute[74882]:   <name>instance-0000001b</name>
Nov 21 14:28:42 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:28:42 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:28:42 user nova-compute[74882]:   <metadata>
Nov 21 14:28:42 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:28:42 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:28:42 user nova-compute[74882]:       <nova:name>tempest-VolumesActionsTest-instance-1129360862</nova:name>
Nov 21 14:28:42 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:28:42</nova:creationTime>
Nov 21 14:28:42 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:28:42 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:28:42 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:28:42 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:28:42 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:28:42 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:28:42 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:28:42 user nova-compute[74882]:       <nova:owner>
Nov 21 14:28:42 user nova-compute[74882]:         <nova:user uuid="a95c719f033946038ed21c53704577b1">tempest-VolumesActionsTest-1401937880-project-member</nova:user>
Nov 21 14:28:42 user nova-compute[74882]:         <nova:project uuid="a42118796db243d7a72988931f9915fc">tempest-VolumesActionsTest-1401937880</nova:project>
Nov 21 14:28:42 user nova-compute[74882]:       </nova:owner>
Nov 21 14:28:42 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:28:42 user nova-compute[74882]:       <nova:ports>
Nov 21 14:28:42 user nova-compute[74882]:         <nova:port uuid="630cdcfd-f631-4d1b-8d7d-a0706074f1bb">
Nov 21 14:28:42 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 21 14:28:42 user nova-compute[74882]:         </nova:port>
Nov 21 14:28:42 user nova-compute[74882]:       </nova:ports>
Nov 21 14:28:42 user nova-compute[74882]:     </nova:instance>
Nov 21 14:28:42 user nova-compute[74882]:   </metadata>
Nov 21 14:28:42 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:28:42 user nova-compute[74882]:     <system>
Nov 21 14:28:42 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:28:42 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:28:42 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:28:42 user nova-compute[74882]:       <entry name="serial">8982cace-751d-41d6-9131-561f6b55ca54</entry>
Nov 21 14:28:42 user nova-compute[74882]:       <entry name="uuid">8982cace-751d-41d6-9131-561f6b55ca54</entry>
Nov 21 14:28:42 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:28:42 user nova-compute[74882]:     </system>
Nov 21 14:28:42 user nova-compute[74882]:   </sysinfo>
Nov 21 14:28:42 user nova-compute[74882]:   <os>
Nov 21 14:28:42 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:28:42 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:28:42 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:28:42 user nova-compute[74882]:   </os>
Nov 21 14:28:42 user nova-compute[74882]:   <features>
Nov 21 14:28:42 user nova-compute[74882]:     <acpi/>
Nov 21 14:28:42 user nova-compute[74882]:     <apic/>
Nov 21 14:28:42 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:28:42 user nova-compute[74882]:   </features>
Nov 21 14:28:42 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:28:42 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:28:42 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:28:42 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:28:42 user nova-compute[74882]:   </clock>
Nov 21 14:28:42 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:28:42 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:28:42 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:28:42 user nova-compute[74882]:   </cpu>
Nov 21 14:28:42 user nova-compute[74882]:   <devices>
Nov 21 14:28:42 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:28:42 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:28:42 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk"/>
Nov 21 14:28:42 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:28:42 user nova-compute[74882]:     </disk>
Nov 21 14:28:42 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:28:42 user nova-compute[74882]:       <mac address="fa:16:3e:6e:97:8f"/>
Nov 21 14:28:42 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:42 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:28:42 user nova-compute[74882]:       <target dev="tap630cdcfd-f6"/>
Nov 21 14:28:42 user nova-compute[74882]:     </interface>
Nov 21 14:28:42 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:28:42 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/console.log" append="off"/>
Nov 21 14:28:42 user nova-compute[74882]:     </serial>
Nov 21 14:28:42 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:28:42 user nova-compute[74882]:     <video>
Nov 21 14:28:42 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:42 user nova-compute[74882]:     </video>
Nov 21 14:28:42 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:28:42 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:28:42 user nova-compute[74882]:     </rng>
Nov 21 14:28:42 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:28:42 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:28:42 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:28:42 user nova-compute[74882]:     </memballoon>
Nov 21 14:28:42 user nova-compute[74882]:   </devices>
Nov 21 14:28:42 user nova-compute[74882]: </domain>
Nov 21 14:28:42 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1129360862',display_name='tempest-VolumesActionsTest-instance-1129360862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1129360862',id=27,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a42118796db243d7a72988931f9915fc',ramdisk_id='',reservation_id='r-7ifgx8hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1401937880',owner_user_name='tempest-VolumesActionsTest-1401937880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:28:41Z,user_data=None,user_id='a95c719f033946038ed21c53704577b1',uuid=8982cace-751d-41d6-9131-561f6b55ca54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converting VIF {"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:8f,bridge_name='br-int',has_traffic_filtering=True,id=630cdcfd-f631-4d1b-8d7d-a0706074f1bb,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630cdcfd-f6') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG os_vif [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:8f,bridge_name='br-int',has_traffic_filtering=True,id=630cdcfd-f631-4d1b-8d7d-a0706074f1bb,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630cdcfd-f6') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e987761e-918e-5179-b767-a6485de9c147', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap630cdcfd-f6, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap630cdcfd-f6, col_values=(('qos', UUID('5552041f-eca9-43f5-8dc2-7709dc98f7c5')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap630cdcfd-f6, col_values=(('external_ids', {'iface-id': '630cdcfd-f631-4d1b-8d7d-a0706074f1bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:97:8f', 'vm-uuid': '8982cace-751d-41d6-9131-561f6b55ca54'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: INFO os_vif [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:8f,bridge_name='br-int',has_traffic_filtering=True,id=630cdcfd-f631-4d1b-8d7d-a0706074f1bb,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630cdcfd-f6')
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] No VIF found with MAC fa:16:3e:6e:97:8f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG nova.network.neutron [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Updated VIF entry in instance network info cache for port 630cdcfd-f631-4d1b-8d7d-a0706074f1bb. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG nova.network.neutron [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Updating instance_info_cache with network_info: [{"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47a1c332-fec3-438c-a180-22e702d75b57 req-5169b3d4-a66b-42a2-a389-e0e4e507bb0c service nova] Releasing lock "refresh_cache-8982cace-751d-41d6-9131-561f6b55ca54" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Port 23e1e132-07a0-4650-9032-872a2dfeafb4 binding to destination host user is already ACTIVE {{(pid=74882) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Creating tmpfile /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/tmpb_6_67ld to verify with other compute node that the instance is on the same shared storage. {{(pid=74882) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:44 user nova-compute[74882]: WARNING nova.compute.manager [req-76c5481e-0ba4-48fc-a975-651566033088 req-57485db6-243a-46e4-98a1-567d517c9e52 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state resized and task_state resize_reverting.
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received event network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Acquiring lock "24342449-c859-4f3d-a215-4f1930a612b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] No waiting events found dispatching network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:44 user nova-compute[74882]: WARNING nova.compute.manager [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received unexpected event network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance with vm_state building and task_state spawning.
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received event network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Acquiring lock "24342449-c859-4f3d-a215-4f1930a612b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] No waiting events found dispatching network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:44 user nova-compute[74882]: WARNING nova.compute.manager [req-61c414b1-d614-4161-8e8f-c0a391a9944b req-21e122b6-aaab-42e7-ae8c-65fd72ae349f service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received unexpected event network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance with vm_state building and task_state spawning.
Nov 21 14:28:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance destroyed successfully.
Nov 21 14:28:44 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lazy-loading 'resources' on Instance uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_vif [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23e1e132-07, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa58b5f2-333a-44ed-ad9b-13017fb85d72) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: INFO os_vif [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07')
Nov 21 14:28:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:28:45 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5078b1a-0087-48b9-b792-b14645a548d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:28:45 user nova-compute[74882]: No targets found.
Nov 21 14:28:45 user nova-compute[74882]: iSNS:
Nov 21 14:28:45 user nova-compute[74882]: No targets found.
Nov 21 14:28:45 user nova-compute[74882]: STATIC:
Nov 21 14:28:45 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:28:45 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:28:45 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:28:45 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:28:45 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:28:45 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:28:45 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90
Nov 21 14:28:45 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:28:45 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:28:45 user nova-compute[74882]: FIRMWARE:
Nov 21 14:28:45 user nova-compute[74882]: No targets found.
Nov 21 14:28:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:28:45 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:28:45 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[41015665-0ee3-436e-bf0b-bead440b8a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd0ba76-a652-42c3-a5f0-4e0187df6e57]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:45 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:45 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:45 user nova-compute[74882]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:45 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c555000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe1b7a-92a2-431f-aed8-838139770c15]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[022a42d4-e892-4bc0-89d1-9847d35d814d]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.033s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba61a09-c3e2-4156-9007-19bda83fab15]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[086774f6-1e71-489a-a0d5-c6daa78c2c0f]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[605d8aa7-3084-41f7-a8f6-41d360b3e08c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa2822e-d4a8-4840-bd44-c147e4bc20a8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]
Nov 21 14:28:45 user nova-compute[74882]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.
Nov 21 14:28:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[043739b2-dbb2-4871-898a-0ed3cd4cb222]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== disconnect_volume: return (380ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:46 user nova-compute[74882]: WARNING nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state resized and task_state resize_reverting.
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received event network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Acquiring lock "8982cace-751d-41d6-9131-561f6b55ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] No waiting events found dispatching network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:46 user nova-compute[74882]: WARNING nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received unexpected event network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance with vm_state building and task_state spawning.
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received event network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Acquiring lock "8982cace-751d-41d6-9131-561f6b55ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] No waiting events found dispatching network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:46 user nova-compute[74882]: WARNING nova.compute.manager [req-d7bafa69-152b-4c1e-8f01-253cc67eb358 req-8463f791-0127-4557-8699-63e05670a98c service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received unexpected event network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance with vm_state building and task_state spawning.
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lazy-loading 'migration_context' on Instance uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.objects.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Object Instance<101c9eaa-a8f5-4840-a1d7-454b0be5d5d0> lazy-loaded attributes: resources,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:28:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Instance spawned successfully.
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:28:46 user nova-compute[74882]: INFO nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Took 7.92 seconds to spawn the instance on the hypervisor.
Nov 21 14:28:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.474s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:47 user nova-compute[74882]: INFO nova.compute.manager [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Took 8.91 seconds to build instance.
Nov 21 14:28:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-39772b8d-316b-41d2-b92e-4902f84a6f76 tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "24342449-c859-4f3d-a215-4f1930a612b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.018s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:47 user nova-compute[74882]: INFO nova.compute.manager [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Swapping old allocation on dict_keys(['f2c18da1-f4fd-49b6-a78a-043389a6ebfc']) held by migration 04e7ab0d-572c-47f4-b186-8fe515b2f8ff for instance
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Overwriting current allocation {'allocations': {'f2c18da1-f4fd-49b6-a78a-043389a6ebfc': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 31}}, 'project_id': 'ccf822369a824ed3912173b2f27fddbf', 'user_id': 'a19fbffc4df04656950aa2bb1a2bb48a', 'consumer_generation': 1} on consumer 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:28:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Instance spawned successfully.
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:28:47 user nova-compute[74882]: INFO nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 21 14:28:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:28:47 user nova-compute[74882]: INFO nova.compute.manager [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Took 7.73 seconds to build instance.
Nov 21 14:28:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f842a330-ec05-44e1-bfa1-b0b5c22824cb tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "8982cace-751d-41d6-9131-561f6b55ca54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.869s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG os_brick.utils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1112961f-1a6f-46bc-ab2c-76d0f2884c52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb5d84-d118-4bfc-bd60-e2b022522532]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8159c8-848d-4364-bbf2-e71332541db5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5188b871-7671-43dd-a783-c7eaa566667a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:28:48 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:28:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2484e3a2-704c-4384-bea5-96e2fc393fe7]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:28:48 user nova-compute[74882]: DEBUG os_brick.utils [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:28:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:53 user nova-compute[74882]: INFO nova.compute.manager [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Unrescuing
Nov 21 14:28:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating instance_info_cache with network_info: [{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'flavor' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:54 user nova-compute[74882]: WARNING nova.compute.manager [req-f08fd6e9-ea4e-4314-8cfd-d90aaa2b8656 req-1db33163-7edb-407c-bbb1-d1f23edf7074 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:28:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance destroyed successfully.
Nov 21 14:28:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Starting finish_revert_migration {{(pid=74882) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Start _get_guest_xml network_info=[{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '101c9eaa-a8f5-4840-a1d7-454b0be5d5d0', 'attached_at': '2023-11-21T14:28:55.000000', 'detached_at': '', 'volume_id': '80204876-2834-4680-8b28-90fd14c4ae35', 'serial': '80204876-2834-4680-8b28-90fd14c4ae35'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': '04af40e1-a343-4f14-8412-a762c690c660', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:28:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lazy-loading 'vcpu_model' on Instance uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:28:55 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:28:55 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:28:55 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba2be4c-3cae-4932-b4f8-870a2bb96ef7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:28:55 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e61c026-538a-4642-806a-88ca8745deb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35] added
Nov 21 14:28:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b95f207-f341-4594-8d76-5a089550efc4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[630e2aa2-3515-4429-9bf1-bb98b69709dc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjqTdmgH {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjqTdmgH" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2157ebd4-bd75-4b3e-845e-6b3e03d69db0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NjqTdmgH'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b07a4-3867-4dad-88f4-9ede373e91af]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6913456-22c7-406f-8d2a-6cd8b7e1ef76]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba79609-9a2b-40cd-9ecf-50e3ed00d737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]
Nov 21 14:28:55 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.
Nov 21 14:28:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c6c25b-b7f0-4a29-92a0-86c6011dcaaf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd18cdb5-e502-4559-a0ee-ea8809d08b2b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:28:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdeaf53-8d92-4e2e-b186-e684f641c0f5]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:28:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:56 user nova-compute[74882]: WARNING nova.compute.manager [req-18d86139-bc32-41a6-9a96-1202491fa628 req-412547cd-4947-4dc0-a46d-fdd89045cec3 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23665346634303731', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665346634303731', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:28:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:28:56 user nova-compute[74882]:   <uuid>101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</uuid>
Nov 21 14:28:56 user nova-compute[74882]:   <name>instance-00000012</name>
Nov 21 14:28:56 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:28:56 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:28:56 user nova-compute[74882]:   <metadata>
Nov 21 14:28:56 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:28:56 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:28:56 user nova-compute[74882]:       <nova:name>tempest-ServerActionsTestOtherB-server-1299552937</nova:name>
Nov 21 14:28:56 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:28:55</nova:creationTime>
Nov 21 14:28:56 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:28:56 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:28:56 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:28:56 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:28:56 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:28:56 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:28:56 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:28:56 user nova-compute[74882]:       <nova:owner>
Nov 21 14:28:56 user nova-compute[74882]:         <nova:user uuid="a19fbffc4df04656950aa2bb1a2bb48a">tempest-ServerActionsTestOtherB-2073286927-project-member</nova:user>
Nov 21 14:28:56 user nova-compute[74882]:         <nova:project uuid="ccf822369a824ed3912173b2f27fddbf">tempest-ServerActionsTestOtherB-2073286927</nova:project>
Nov 21 14:28:56 user nova-compute[74882]:       </nova:owner>
Nov 21 14:28:56 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:28:56 user nova-compute[74882]:       <nova:ports>
Nov 21 14:28:56 user nova-compute[74882]:         <nova:port uuid="23e1e132-07a0-4650-9032-872a2dfeafb4">
Nov 21 14:28:56 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 21 14:28:56 user nova-compute[74882]:         </nova:port>
Nov 21 14:28:56 user nova-compute[74882]:       </nova:ports>
Nov 21 14:28:56 user nova-compute[74882]:     </nova:instance>
Nov 21 14:28:56 user nova-compute[74882]:   </metadata>
Nov 21 14:28:56 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:28:56 user nova-compute[74882]:     <system>
Nov 21 14:28:56 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:28:56 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:28:56 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:28:56 user nova-compute[74882]:       <entry name="serial">101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</entry>
Nov 21 14:28:56 user nova-compute[74882]:       <entry name="uuid">101c9eaa-a8f5-4840-a1d7-454b0be5d5d0</entry>
Nov 21 14:28:56 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:28:56 user nova-compute[74882]:     </system>
Nov 21 14:28:56 user nova-compute[74882]:   </sysinfo>
Nov 21 14:28:56 user nova-compute[74882]:   <os>
Nov 21 14:28:56 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:28:56 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:28:56 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:28:56 user nova-compute[74882]:   </os>
Nov 21 14:28:56 user nova-compute[74882]:   <features>
Nov 21 14:28:56 user nova-compute[74882]:     <acpi/>
Nov 21 14:28:56 user nova-compute[74882]:     <apic/>
Nov 21 14:28:56 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:28:56 user nova-compute[74882]:   </features>
Nov 21 14:28:56 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:28:56 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:28:56 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:28:56 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:28:56 user nova-compute[74882]:   </clock>
Nov 21 14:28:56 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:28:56 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:28:56 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:28:56 user nova-compute[74882]:   </cpu>
Nov 21 14:28:56 user nova-compute[74882]:   <devices>
Nov 21 14:28:56 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:28:56 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:28:56 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk"/>
Nov 21 14:28:56 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:28:56 user nova-compute[74882]:     </disk>
Nov 21 14:28:56 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:28:56 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:28:56 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 14:28:56 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:28:56 user nova-compute[74882]:       <serial>80204876-2834-4680-8b28-90fd14c4ae35</serial>
Nov 21 14:28:56 user nova-compute[74882]:     </disk>
Nov 21 14:28:56 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:28:56 user nova-compute[74882]:       <mac address="fa:16:3e:c6:d9:99"/>
Nov 21 14:28:56 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:56 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:28:56 user nova-compute[74882]:       <target dev="tap23e1e132-07"/>
Nov 21 14:28:56 user nova-compute[74882]:     </interface>
Nov 21 14:28:56 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:28:56 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/console.log" append="off"/>
Nov 21 14:28:56 user nova-compute[74882]:     </serial>
Nov 21 14:28:56 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:28:56 user nova-compute[74882]:     <video>
Nov 21 14:28:56 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:28:56 user nova-compute[74882]:     </video>
Nov 21 14:28:56 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:28:56 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:28:56 user nova-compute[74882]:     </rng>
Nov 21 14:28:56 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:28:56 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:28:56 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:28:56 user nova-compute[74882]:     </memballoon>
Nov 21 14:28:56 user nova-compute[74882]:   </devices>
Nov 21 14:28:56 user nova-compute[74882]: </domain>
Nov 21 14:28:56 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:28:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG os_vif [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59bb2502-597a-5fb4-8ec5-6e43ac1122fd', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23e1e132-07, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23e1e132-07, col_values=(('qos', UUID('fb0deffc-71c7-40e0-b275-a76234e66a0d')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23e1e132-07, col_values=(('external_ids', {'iface-id': '23e1e132-07a0-4650-9032-872a2dfeafb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:d9:99', 'vm-uuid': '101c9eaa-a8f5-4840-a1d7-454b0be5d5d0'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:28:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:56 user nova-compute[74882]: INFO os_vif [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07')
Nov 21 14:28:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:58 user nova-compute[74882]: WARNING nova.compute.manager [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:28:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:58 user nova-compute[74882]: WARNING nova.compute.manager [req-cf8b82de-0e18-4f0c-bd02-fc801c5bf722 req-b2fdbe82-41ff-4795-84ef-57e8803dbc1c service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:28:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a010fe63-cfef-4939-a5db-928ea6cdbb63 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:28:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:28:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:28:59 user nova-compute[74882]: WARNING nova.compute.manager [req-f7d16e7b-22bd-4fbf-adc1-59cd1531fbb5 req-97354b16-2848-4b06-96d3-b540138b9c32 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state resized and task_state resize_reverting.
Nov 21 14:28:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:28:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:29:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance running successfully.
Nov 21 14:29:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] finish_revert_migration finished successfully. {{(pid=74882) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 21 14:29:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:29:01 user nova-compute[74882]: WARNING nova.compute.manager [req-c5649ecf-4190-4e76-8382-f921447e98b2 req-31ebfc41-70d7-4490-9a16-7e1503c7f561 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state resized and task_state resize_reverting.
Nov 21 14:29:01 user nova-compute[74882]: INFO nova.compute.manager [None req-4bce299d-a3f7-4438-8498-524a389c0a1c tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance to original state: 'active'
Nov 21 14:29:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:02 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 is timed out.
Nov 21 14:29:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config.
Nov 21 14:29:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPpQKfWx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:29:02 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8368d85-5d17-482f-bce5-424a847dc769]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:29:02 user nova-compute[74882]: No targets found.
Nov 21 14:29:02 user nova-compute[74882]: iSNS:
Nov 21 14:29:02 user nova-compute[74882]: No targets found.
Nov 21 14:29:02 user nova-compute[74882]: STATIC:
Nov 21 14:29:02 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:29:02 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:29:02 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:29:02 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:29:02 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:29:02 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:29:02 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90
Nov 21 14:29:02 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:29:02 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:29:02 user nova-compute[74882]: FIRMWARE:
Nov 21 14:29:02 user nova-compute[74882]: No targets found.
Nov 21 14:29:02 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:29:02 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:29:02 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3294ef-a4f0-4744-8515-a69222a241a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c07653-14d1-4910-8131-170e7b0b6734]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:02 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:29:02 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:02 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:02 user nova-compute[74882]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 (non-flash)
Nov 21 14:29:02 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:02 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c462dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1939e-ce5c-45df-ab35-29d62d6b4da1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8a05e2-43fc-45d6-b02a-8c333e2f49e1]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6138edb-7251-4b53-9d50-e5d92d425e40]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0627c8d9-5ab7-4df4-b73a-27fcc80dbf47]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace3f814-606e-4d6c-ad88-ece8e6e4591c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f765a4-e931-4d88-98cb-d19c62760420]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260]
Nov 21 14:29:03 user nova-compute[74882]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90, portal: 172.16.0.220,3260] successful.
Nov 21 14:29:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13cbcfe3-a17f-4e37-afd6-47e28eed9d90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d4bebf-a415-4640-b49d-c45c32836f9a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== disconnect_volume: return (323ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:29:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-03da65a2-37eb-4ab8-8fc9-b49a36c521e3 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.058s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:29:08 user nova-compute[74882]: INFO nova.compute.claims [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Claim successful on node user
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Updating resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc generation from 33 to 34 during operation: update_aggregates {{(pid=74882) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.124s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:29:08 user nova-compute[74882]: INFO nova.compute.claims [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Claim successful on node user
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:29:08 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:29:08 user nova-compute[74882]: DEBUG nova.policy [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:29:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Creating image(s)
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk 1073741824" returned: 0 in 0.066s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.policy [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.207s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:29:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:29:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Creating image(s)
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.371s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Successfully created port: 1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.443s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Cannot resize image /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Ensure instance console log exists: /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Successfully created port: 2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk 1073741824" returned: 0 in 0.051s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.211s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Successfully updated port: 1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-changed-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Refreshing instance network info cache due to event network-changed-1e015b80-8ab0-446f-aebd-541aaae71b0f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Acquiring lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Acquired lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Refreshing network info cache for port 1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:29:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Cannot resize image /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Ensure instance console log exists: /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Successfully updated port: 2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-changed-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Refreshing instance network info cache due to event network-changed-2076301e-56e7-4d67-90db-192335b0f56c. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Acquiring lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d8a47a54-cf00-441b-a587-812c4dcee55c req-2ae6c9ac-bbbf-4385-8fc2-6e8a72e303f2 service nova] Releasing lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance network_info: |[{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Start _get_guest_xml network_info=[{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:29:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175800306',display_name='tempest-ServerRescueNegativeTestJSON-server-175800306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175800306',id=28,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-6t5y3swy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:09Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=8f8ecb76-9606-4119-a5e6-53fe33413b0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:29:11 user nova-compute[74882]:   <uuid>8f8ecb76-9606-4119-a5e6-53fe33413b0c</uuid>
Nov 21 14:29:11 user nova-compute[74882]:   <name>instance-0000001c</name>
Nov 21 14:29:11 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:29:11 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:29:11 user nova-compute[74882]:   <metadata>
Nov 21 14:29:11 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:29:11 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-175800306</nova:name>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:29:11</nova:creationTime>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:29:11 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:29:11 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:owner>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:user uuid="4b8ebb88fee544a793fd71ebeee0845f">tempest-ServerRescueNegativeTestJSON-2007417611-project-member</nova:user>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:project uuid="e50c445b6ade47c09380da2248cf5954">tempest-ServerRescueNegativeTestJSON-2007417611</nova:project>
Nov 21 14:29:11 user nova-compute[74882]:       </nova:owner>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:ports>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:port uuid="1e015b80-8ab0-446f-aebd-541aaae71b0f">
Nov 21 14:29:11 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:29:11 user nova-compute[74882]:         </nova:port>
Nov 21 14:29:11 user nova-compute[74882]:       </nova:ports>
Nov 21 14:29:11 user nova-compute[74882]:     </nova:instance>
Nov 21 14:29:11 user nova-compute[74882]:   </metadata>
Nov 21 14:29:11 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:29:11 user nova-compute[74882]:     <system>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="serial">8f8ecb76-9606-4119-a5e6-53fe33413b0c</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="uuid">8f8ecb76-9606-4119-a5e6-53fe33413b0c</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:29:11 user nova-compute[74882]:     </system>
Nov 21 14:29:11 user nova-compute[74882]:   </sysinfo>
Nov 21 14:29:11 user nova-compute[74882]:   <os>
Nov 21 14:29:11 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:29:11 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:29:11 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:29:11 user nova-compute[74882]:   </os>
Nov 21 14:29:11 user nova-compute[74882]:   <features>
Nov 21 14:29:11 user nova-compute[74882]:     <acpi/>
Nov 21 14:29:11 user nova-compute[74882]:     <apic/>
Nov 21 14:29:11 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:29:11 user nova-compute[74882]:   </features>
Nov 21 14:29:11 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:29:11 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:29:11 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:29:11 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:29:11 user nova-compute[74882]:   </clock>
Nov 21 14:29:11 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:29:11 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:29:11 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:29:11 user nova-compute[74882]:   </cpu>
Nov 21 14:29:11 user nova-compute[74882]:   <devices>
Nov 21 14:29:11 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:29:11 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:29:11 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk"/>
Nov 21 14:29:11 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:29:11 user nova-compute[74882]:     </disk>
Nov 21 14:29:11 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:29:11 user nova-compute[74882]:       <mac address="fa:16:3e:6b:07:97"/>
Nov 21 14:29:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:29:11 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:29:11 user nova-compute[74882]:       <target dev="tap1e015b80-8a"/>
Nov 21 14:29:11 user nova-compute[74882]:     </interface>
Nov 21 14:29:11 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:29:11 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/console.log" append="off"/>
Nov 21 14:29:11 user nova-compute[74882]:     </serial>
Nov 21 14:29:11 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:29:11 user nova-compute[74882]:     <video>
Nov 21 14:29:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:29:11 user nova-compute[74882]:     </video>
Nov 21 14:29:11 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:29:11 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:29:11 user nova-compute[74882]:     </rng>
Nov 21 14:29:11 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:29:11 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:29:11 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:29:11 user nova-compute[74882]:     </memballoon>
Nov 21 14:29:11 user nova-compute[74882]:   </devices>
Nov 21 14:29:11 user nova-compute[74882]: </domain>
Nov 21 14:29:11 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175800306',display_name='tempest-ServerRescueNegativeTestJSON-server-175800306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175800306',id=28,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-6t5y3swy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:09Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=8f8ecb76-9606-4119-a5e6-53fe33413b0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG os_vif [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9f2d6c0-23ac-59fd-a4e5-82c216e80e75', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e015b80-8a, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e015b80-8a, col_values=(('qos', UUID('4fefc381-abfd-473e-b1cd-1f1c98540922')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e015b80-8a, col_values=(('external_ids', {'iface-id': '1e015b80-8ab0-446f-aebd-541aaae71b0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:07:97', 'vm-uuid': '8f8ecb76-9606-4119-a5e6-53fe33413b0c'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updating instance_info_cache with network_info: [{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: INFO os_vif [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a')
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance network_info: |[{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Acquired lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Refreshing network info cache for port 2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Start _get_guest_xml network_info=[{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:29:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-71590957',display_name='tempest-ServerRescueNegativeTestJSON-server-71590957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-71590957',id=29,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5kn0lgrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:10Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=ebf25b5a-9531-4058-8e86-372fef1517e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'pci_devices' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:29:11 user nova-compute[74882]:   <uuid>ebf25b5a-9531-4058-8e86-372fef1517e0</uuid>
Nov 21 14:29:11 user nova-compute[74882]:   <name>instance-0000001d</name>
Nov 21 14:29:11 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:29:11 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:29:11 user nova-compute[74882]:   <metadata>
Nov 21 14:29:11 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:29:11 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-71590957</nova:name>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:29:11</nova:creationTime>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:29:11 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:29:11 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:owner>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:user uuid="4b8ebb88fee544a793fd71ebeee0845f">tempest-ServerRescueNegativeTestJSON-2007417611-project-member</nova:user>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:project uuid="e50c445b6ade47c09380da2248cf5954">tempest-ServerRescueNegativeTestJSON-2007417611</nova:project>
Nov 21 14:29:11 user nova-compute[74882]:       </nova:owner>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:29:11 user nova-compute[74882]:       <nova:ports>
Nov 21 14:29:11 user nova-compute[74882]:         <nova:port uuid="2076301e-56e7-4d67-90db-192335b0f56c">
Nov 21 14:29:11 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 21 14:29:11 user nova-compute[74882]:         </nova:port>
Nov 21 14:29:11 user nova-compute[74882]:       </nova:ports>
Nov 21 14:29:11 user nova-compute[74882]:     </nova:instance>
Nov 21 14:29:11 user nova-compute[74882]:   </metadata>
Nov 21 14:29:11 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:29:11 user nova-compute[74882]:     <system>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="serial">ebf25b5a-9531-4058-8e86-372fef1517e0</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="uuid">ebf25b5a-9531-4058-8e86-372fef1517e0</entry>
Nov 21 14:29:11 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:29:11 user nova-compute[74882]:     </system>
Nov 21 14:29:11 user nova-compute[74882]:   </sysinfo>
Nov 21 14:29:11 user nova-compute[74882]:   <os>
Nov 21 14:29:11 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:29:11 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:29:11 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:29:11 user nova-compute[74882]:   </os>
Nov 21 14:29:11 user nova-compute[74882]:   <features>
Nov 21 14:29:11 user nova-compute[74882]:     <acpi/>
Nov 21 14:29:11 user nova-compute[74882]:     <apic/>
Nov 21 14:29:11 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:29:11 user nova-compute[74882]:   </features>
Nov 21 14:29:11 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:29:11 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:29:11 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:29:11 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:29:11 user nova-compute[74882]:   </clock>
Nov 21 14:29:11 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:29:11 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:29:11 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:29:11 user nova-compute[74882]:   </cpu>
Nov 21 14:29:11 user nova-compute[74882]:   <devices>
Nov 21 14:29:11 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:29:11 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:29:11 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk"/>
Nov 21 14:29:11 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:29:11 user nova-compute[74882]:     </disk>
Nov 21 14:29:11 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:29:11 user nova-compute[74882]:       <mac address="fa:16:3e:bc:e3:29"/>
Nov 21 14:29:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:29:11 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:29:11 user nova-compute[74882]:       <target dev="tap2076301e-56"/>
Nov 21 14:29:11 user nova-compute[74882]:     </interface>
Nov 21 14:29:11 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:29:11 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/console.log" append="off"/>
Nov 21 14:29:11 user nova-compute[74882]:     </serial>
Nov 21 14:29:11 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:29:11 user nova-compute[74882]:     <video>
Nov 21 14:29:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:29:11 user nova-compute[74882]:     </video>
Nov 21 14:29:11 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:29:11 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:29:11 user nova-compute[74882]:     </rng>
Nov 21 14:29:11 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:29:11 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:29:11 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:29:11 user nova-compute[74882]:     </memballoon>
Nov 21 14:29:11 user nova-compute[74882]:   </devices>
Nov 21 14:29:11 user nova-compute[74882]: </domain>
Nov 21 14:29:11 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-71590957',display_name='tempest-ServerRescueNegativeTestJSON-server-71590957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-71590957',id=29,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5kn0lgrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:10Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=ebf25b5a-9531-4058-8e86-372fef1517e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG os_vif [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e2f9303-1ac9-5f38-a4f2-6e3a54524c14', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No VIF found with MAC fa:16:3e:6b:07:97, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2076301e-56, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2076301e-56, col_values=(('qos', UUID('2b24098a-18e5-4245-9524-41d4afe95007')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2076301e-56, col_values=(('external_ids', {'iface-id': '2076301e-56e7-4d67-90db-192335b0f56c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:e3:29', 'vm-uuid': 'ebf25b5a-9531-4058-8e86-372fef1517e0'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:11 user nova-compute[74882]: INFO os_vif [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56')
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:29:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No VIF found with MAC fa:16:3e:bc:e3:29, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updated VIF entry in instance network info cache for port 2076301e-56e7-4d67-90db-192335b0f56c. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG nova.network.neutron [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updating instance_info_cache with network_info: [{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e9150699-e075-4488-b2bc-0465fc281049 req-df51523f-00b9-479a-9ccb-96e02efece64 service nova] Releasing lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:12 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:29:12 user nova-compute[74882]: INFO nova.compute.claims [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Claim successful on node user
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:29:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:29:13 user nova-compute[74882]: INFO nova.virt.block_device [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Booting with volume 5b68b64e-527c-465a-96b2-a2fa96e9cb6f at /dev/vda
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.policy [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9f06e22265f45beb3760ea3b9338c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079d8162d1ea42ddbf31668c8a44cf73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG os_brick.utils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed410070-e3f9-43ae-ace3-882db48761db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c128fdb8-5ea6-46ce-a4d8-6342d308bf25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68fc03-2570-4398-be3e-f320fd806f26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f877a0c7-8ff0-4d71-ab33-5eb6b29753b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:29:13 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:29:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeeefd3-9261-4965-bf90-b8fdc0c832ee]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG os_brick.utils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating existing volume attachment record: 3989d687-664d-4064-a20e-04459507eb5c {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:29:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Successfully created port: 388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:29:14 user nova-compute[74882]: WARNING nova.compute.manager [req-8a65ff20-278e-4f79-b09a-f7bebff6b59f req-17080c98-a1a9-4d88-abe3-38cf7aaf4d3d service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state building and task_state spawning.
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:29:14 user nova-compute[74882]: WARNING nova.compute.manager [req-3f7be5b0-d2e3-4432-9942-4e3a67989c43 req-dda084e3-9c7a-4b27-aef6-0adb9a4ab22a service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received unexpected event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with vm_state building and task_state spawning.
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG nova.network.neutron [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Successfully updated port: 388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquired lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG nova.network.neutron [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:29:14 user nova-compute[74882]: DEBUG nova.network.neutron [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating instance_info_cache with network_info: [{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:29:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Releasing lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:29:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance network_info: |[{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:29:16 user nova-compute[74882]: WARNING nova.compute.manager [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state building and task_state spawning.
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-changed-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Refreshing instance network info cache due to event network-changed-388999f8-b374-406c-9d58-855ff9c23da8. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Acquiring lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Acquired lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Refreshing network info cache for port 388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:29:16 user nova-compute[74882]: WARNING nova.compute.manager [req-666ca632-127e-47ae-962c-a64dc876e127 req-de5fda78-91b8-472a-8b41-4bf6d1ff497d service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received unexpected event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with vm_state building and task_state spawning.
Nov 21 14:29:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updated VIF entry in instance network info cache for port 388999f8-b374-406c-9d58-855ff9c23da8. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating instance_info_cache with network_info: [{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b1ae7983-0679-49dd-8389-d2078e4dfe78 req-5cdb0d7f-0757-4647-a26e-9abf398021f4 service nova] Releasing lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:29:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance spawned successfully.
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:29:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance spawned successfully.
Nov 21 14:29:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:17 user nova-compute[74882]: INFO nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Took 8.05 seconds to spawn the instance on the hypervisor.
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:29:17 user nova-compute[74882]: INFO nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 21 14:29:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:17 user nova-compute[74882]: INFO nova.compute.manager [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Took 9.26 seconds to build instance.
Nov 21 14:29:17 user nova-compute[74882]: INFO nova.compute.manager [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Took 8.54 seconds to build instance.
Nov 21 14:29:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4fb41aa-c947-44ba-be9c-26e0a6a41095 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.385s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ee0605cb-c8a7-41d6-b50c-2bb2c7c3fac1 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.677s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:29:19 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Creating image(s)
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Ensure instance console log exists: /opt/stack/data/nova/instances/9a6ece97-45cb-4033-8590-e97182af0a42/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Start _get_guest_xml network_info=[{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a6ece97-45cb-4033-8590-e97182af0a42', 'attached_at': '', 'detached_at': '', 'volume_id': '5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'serial': '5b68b64e-527c-465a-96b2-a2fa96e9cb6f'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '3989d687-664d-4064-a20e-04459507eb5c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:29:19 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:19 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:29:19 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:29:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:29:19 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:29:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:29:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:29:19 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:29:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1399b7-5392-460d-a8bb-a29979cf60c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:29:20 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3473ee5-34fb-4b75-a9ec-74052938f81d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f] added
Nov 21 14:29:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[078929e9-7ac1-4ebf-a6d1-5fc7b43a916f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b745d58-e94c-465f-84f3-28eb0dc26b3c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftkdETvi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftkdETvi" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[92408745-6f69-48b0-adcc-8c76c99e8c7c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ftkdETvi'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[69148b46-8aa6-41bf-ad62-21e17c29617f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[082bccb9-a2a0-45ae-9bec-bfe629db4d08]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7799df1d-a6f8-42e0-a468-133ebc79beaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]
Nov 21 14:29:20 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.
Nov 21 14:29:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f3ab7e-46f9-4054-b96b-5c6851a8a4ff]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[af56504c-0558-4776-8dbc-775a5101f2b5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:29:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:20 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:29:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a856326e-c563-4bba-8455-48a25cccd4ae]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:29:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23963343330316638', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963343330316638', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-765597573',display_name='tempest-ServerActionsTestOtherA-server-765597573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-765597573',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-4ukk56w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=9a6ece97-45cb-4033-8590-e97182af0a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.objects.instance [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a6ece97-45cb-4033-8590-e97182af0a42 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:29:21 user nova-compute[74882]:   <uuid>9a6ece97-45cb-4033-8590-e97182af0a42</uuid>
Nov 21 14:29:21 user nova-compute[74882]:   <name>instance-0000001e</name>
Nov 21 14:29:21 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:29:21 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:29:21 user nova-compute[74882]:   <metadata>
Nov 21 14:29:21 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:29:21 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:29:21 user nova-compute[74882]:       <nova:name>tempest-ServerActionsTestOtherA-server-765597573</nova:name>
Nov 21 14:29:21 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:29:19</nova:creationTime>
Nov 21 14:29:21 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:29:21 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:29:21 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:29:21 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:29:21 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:29:21 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:29:21 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:29:21 user nova-compute[74882]:       <nova:owner>
Nov 21 14:29:21 user nova-compute[74882]:         <nova:user uuid="d9f06e22265f45beb3760ea3b9338c25">tempest-ServerActionsTestOtherA-538546207-project-member</nova:user>
Nov 21 14:29:21 user nova-compute[74882]:         <nova:project uuid="079d8162d1ea42ddbf31668c8a44cf73">tempest-ServerActionsTestOtherA-538546207</nova:project>
Nov 21 14:29:21 user nova-compute[74882]:       </nova:owner>
Nov 21 14:29:21 user nova-compute[74882]:       <nova:ports>
Nov 21 14:29:21 user nova-compute[74882]:         <nova:port uuid="388999f8-b374-406c-9d58-855ff9c23da8">
Nov 21 14:29:21 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:29:21 user nova-compute[74882]:         </nova:port>
Nov 21 14:29:21 user nova-compute[74882]:       </nova:ports>
Nov 21 14:29:21 user nova-compute[74882]:     </nova:instance>
Nov 21 14:29:21 user nova-compute[74882]:   </metadata>
Nov 21 14:29:21 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:29:21 user nova-compute[74882]:     <system>
Nov 21 14:29:21 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:29:21 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:29:21 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:29:21 user nova-compute[74882]:       <entry name="serial">9a6ece97-45cb-4033-8590-e97182af0a42</entry>
Nov 21 14:29:21 user nova-compute[74882]:       <entry name="uuid">9a6ece97-45cb-4033-8590-e97182af0a42</entry>
Nov 21 14:29:21 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:29:21 user nova-compute[74882]:     </system>
Nov 21 14:29:21 user nova-compute[74882]:   </sysinfo>
Nov 21 14:29:21 user nova-compute[74882]:   <os>
Nov 21 14:29:21 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:29:21 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:29:21 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:29:21 user nova-compute[74882]:   </os>
Nov 21 14:29:21 user nova-compute[74882]:   <features>
Nov 21 14:29:21 user nova-compute[74882]:     <acpi/>
Nov 21 14:29:21 user nova-compute[74882]:     <apic/>
Nov 21 14:29:21 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:29:21 user nova-compute[74882]:   </features>
Nov 21 14:29:21 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:29:21 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:29:21 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:29:21 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:29:21 user nova-compute[74882]:   </clock>
Nov 21 14:29:21 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:29:21 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:29:21 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:29:21 user nova-compute[74882]:   </cpu>
Nov 21 14:29:21 user nova-compute[74882]:   <devices>
Nov 21 14:29:21 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:29:21 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:29:21 user nova-compute[74882]:       <source dev="/dev/sdd"/>
Nov 21 14:29:21 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:29:21 user nova-compute[74882]:       <serial>5b68b64e-527c-465a-96b2-a2fa96e9cb6f</serial>
Nov 21 14:29:21 user nova-compute[74882]:     </disk>
Nov 21 14:29:21 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:29:21 user nova-compute[74882]:       <mac address="fa:16:3e:c0:27:22"/>
Nov 21 14:29:21 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:29:21 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:29:21 user nova-compute[74882]:       <target dev="tap388999f8-b3"/>
Nov 21 14:29:21 user nova-compute[74882]:     </interface>
Nov 21 14:29:21 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:29:21 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/9a6ece97-45cb-4033-8590-e97182af0a42/console.log" append="off"/>
Nov 21 14:29:21 user nova-compute[74882]:     </serial>
Nov 21 14:29:21 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:29:21 user nova-compute[74882]:     <video>
Nov 21 14:29:21 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:29:21 user nova-compute[74882]:     </video>
Nov 21 14:29:21 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:29:21 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:29:21 user nova-compute[74882]:     </rng>
Nov 21 14:29:21 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:29:21 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:29:21 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:29:21 user nova-compute[74882]:     </memballoon>
Nov 21 14:29:21 user nova-compute[74882]:   </devices>
Nov 21 14:29:21 user nova-compute[74882]: </domain>
Nov 21 14:29:21 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-765597573',display_name='tempest-ServerActionsTestOtherA-server-765597573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-765597573',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-4ukk56w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=9a6ece97-45cb-4033-8590-e97182af0a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG os_vif [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a54263f8-1625-555e-b817-9cc5d0781b9a', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap388999f8-b3, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap388999f8-b3, col_values=(('qos', UUID('ced23c3b-7983-4afd-9f57-2dc5578774b7')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap388999f8-b3, col_values=(('external_ids', {'iface-id': '388999f8-b374-406c-9d58-855ff9c23da8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:27:22', 'vm-uuid': '9a6ece97-45cb-4033-8590-e97182af0a42'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:21 user nova-compute[74882]: INFO os_vif [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3')
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:29:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No VIF found with MAC fa:16:3e:c0:27:22, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:29:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:29:23 user nova-compute[74882]: WARNING nova.compute.manager [req-3932feb4-8dcd-4c47-9e37-6aa5dc3eeebe req-ac44e67b-d80b-452a-bedf-f776114b535d service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received unexpected event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with vm_state building and task_state spawning.
Nov 21 14:29:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:29:25 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance spawned successfully.
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.compute.manager [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.compute.manager [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:29:25 user nova-compute[74882]: WARNING nova.compute.manager [req-2bc6d753-d0b9-47d7-a546-25b0a0ba3783 req-ff39cd7d-7049-48ba-8978-289d78eb68d5 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received unexpected event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with vm_state building and task_state spawning.
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:29:25 user nova-compute[74882]: INFO nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 21 14:29:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:29:25 user nova-compute[74882]: INFO nova.compute.manager [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Took 12.60 seconds to build instance.
Nov 21 14:29:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b3c95ce-8581-4b83-b8ef-2adf817300f8 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.905s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG nova.objects.instance [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:35 user nova-compute[74882]: INFO nova.compute.manager [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attaching volume 24452970-3b54-4c81-bf93-7813ddff4cf5 to /dev/vdb
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG os_brick.utils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e45e39-c8e1-401b-b260-aa7f7edbfc61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32d2dc-7918-4023-8209-11eb70f07f13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d4195f-205a-4f5c-a862-d9b55b91cdff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87a36f6-5eff-4c31-bfc8-54967cbb1ad6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:29:35 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e49557b-cebc-4593-af03-0792662d574f]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG os_brick.utils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating existing volume attachment record: 23b38dd7-5642-4a69-9af0-c24440ad8858 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:29:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:38 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:38 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7132MB free_disk=25.19399642944336GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance d61339ed-84db-4f60-8d64-292749322a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 24342449-c859-4f3d-a215-4f1930a612b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8982cace-751d-41d6-9131-561f6b55ca54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:29:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [{"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:29:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:29:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvlPOrFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:29:42 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:29:42 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:29:42 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd056c23-e943-4cbc-9f09-95b77be024df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:29:42 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9fe7ce-a7e7-4599-ac58-5c0a7df8322b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5] added
Nov 21 14:29:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[503b058f-48df-44d0-a6ad-aaaf409e4844]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b873c7a1-780b-40ad-b63a-33a9d817dfda]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvlPOrFQ {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvlPOrFQ" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e7d998-ac58-4b08-a1cc-6fc610a23541]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvlPOrFQ'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273f6fd-385d-4a23-acb7-e2b33878cfa9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1400d2-051e-4902-8b8e-c8401bb21ec1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:29:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:29:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdb9c01-9177-4566-9303-96a68e5b865f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260]
Nov 21 14:29:42 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260] successful.
Nov 21 14:29:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd4d4c-a87a-4398-8e8c-cbc0201387e4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98e5af5-d308-4701-a5fa-32e8691d1155]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:29:42 user nova-compute[74882]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 (non-flash)
Nov 21 14:29:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e9b035-1eb0-4416-9691-165f2c49ac5b]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:29:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvlPOrFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:29:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:29:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23730313831643438', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:29:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730313831643438', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:29:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:29:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:29:43 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:29:43 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:29:43 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:29:43 user nova-compute[74882]:   <serial>24452970-3b54-4c81-bf93-7813ddff4cf5</serial>
Nov 21 14:29:43 user nova-compute[74882]: </disk>
Nov 21 14:29:43 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:29:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:29:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:29:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No VIF found with MAC fa:16:3e:c5:66:55, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:29:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-54ef3a4c-aa84-490d-917c-c8dc619c735a tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.357s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:29:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:29:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:29:46 user nova-compute[74882]: INFO nova.compute.manager [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Detaching volume 24452970-3b54-4c81-bf93-7813ddff4cf5
Nov 21 14:29:46 user nova-compute[74882]: INFO nova.virt.block_device [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attempting to driver detach volume 24452970-3b54-4c81-bf93-7813ddff4cf5 from mountpoint /dev/vdb
Nov 21 14:29:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Attempting to detach device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:29:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:29:46 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:29:46 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:29:46 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:29:46 user nova-compute[74882]:   <serial>24452970-3b54-4c81-bf93-7813ddff4cf5</serial>
Nov 21 14:29:46 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:29:46 user nova-compute[74882]: </disk>
Nov 21 14:29:46 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:29:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config.
Nov 21 14:29:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:29:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:29:46 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:29:46 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:29:46 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:29:46 user nova-compute[74882]:   <serial>24452970-3b54-4c81-bf93-7813ddff4cf5</serial>
Nov 21 14:29:46 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:29:46 user nova-compute[74882]: </disk>
Nov 21 14:29:46 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:29:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:29:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:29:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-changed-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Refreshing instance network info cache due to event network-changed-a2e47e55-e8fc-4acc-94b2-affe7175312f. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Acquiring lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Acquired lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Refreshing network info cache for port a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updated VIF entry in instance network info cache for port a2e47e55-e8fc-4acc-94b2-affe7175312f. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updating instance_info_cache with network_info: [{"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:30:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e94fcf4c-6176-4a05-81fc-4c41cb475c8f req-a0e2593e-564d-45ec-a178-441f1adaf803 service nova] Releasing lock "refresh_cache-d61339ed-84db-4f60-8d64-292749322a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:30:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:02 user nova-compute[74882]: DEBUG nova.objects.instance [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid d61339ed-84db-4f60-8d64-292749322a77 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:03 user nova-compute[74882]: INFO nova.compute.manager [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Attaching volume fdd1dfae-2be0-484c-87b7-2e0474ee9287 to /dev/vdb
Nov 21 14:30:03 user nova-compute[74882]: DEBUG os_brick.utils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[555822e0-f52a-4613-8f64-894f17f32c47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[547678ab-6fa2-4ee2-956a-f719ec323e5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822900c-69ee-419f-baf8-8523f12f1f5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb062b-b472-4c2f-b02c-1b0516cc5639]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:03 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:30:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79ab149-1da5-4a90-86a7-36aa16bfc5b3]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG os_brick.utils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:03 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updating existing volume attachment record: 354e0256-d8e9-4256-ae41-74dd42e1a3f5 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:06 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 is timed out.
Nov 21 14:30:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config.
Nov 21 14:30:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvlPOrFQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[93684b86-315e-4ffd-a36d-973fcbff76ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:30:06 user nova-compute[74882]: No targets found.
Nov 21 14:30:06 user nova-compute[74882]: iSNS:
Nov 21 14:30:06 user nova-compute[74882]: No targets found.
Nov 21 14:30:06 user nova-compute[74882]: STATIC:
Nov 21 14:30:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:30:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:30:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5
Nov 21 14:30:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:06 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f
Nov 21 14:30:06 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:06 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:06 user nova-compute[74882]: FIRMWARE:
Nov 21 14:30:06 user nova-compute[74882]: No targets found.
Nov 21 14:30:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:30:06 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:30:06 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dca3ed-1c1e-4300-99d7-90acb32c6f69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6d371e-bbdb-42f7-acfb-490d00ce50ac]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:06 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:06 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:06 user nova-compute[74882]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 (non-flash)
Nov 21 14:30:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:06 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:06 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:06 user nova-compute[74882]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 (non-flash)
Nov 21 14:30:06 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c462440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9908c95-76d1-4013-bcb6-2d64e4916bea]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b15dd-72ef-453f-8605-44dd7f5dada7]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f875b5d-caec-4a18-a007-942a16fdef77]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:30:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff2ee3-a1f2-44a1-9682-2ee267fff41c]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7958efd-a808-44bd-8593-884bdb691bf9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67f6c8e-9b58-49be-b88d-88a89d6695dd]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260]
Nov 21 14:30:07 user nova-compute[74882]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5, portal: 172.16.0.220,3260] successful.
Nov 21 14:30:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24452970-3b54-4c81-bf93-7813ddff4cf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e2b618-d232-4754-ab04-0493c9cce17d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== disconnect_volume: return (288ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG nova.objects.instance [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db35ecf1-4c20-4edd-a087-ca5a9e9e9d54 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.626s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuoHDLez', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:09 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:09 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:09 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8095af41-1753-4ac2-9b0d-87bda1283181]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:30:09 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e9889e-fb4b-4828-80b7-a225818ef31c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287] added
Nov 21 14:30:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f25dd-0aa5-4de5-a16e-8f913220eebb]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ea63a6-bdb9-4798-8666-8c06eb88f82f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuoHDLez {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KuoHDLez" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[485f9688-5134-4a32-9340-9207a42bc226]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KuoHDLez'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.090s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b0d5b-37ad-48d9-afbb-d9d3b57feec8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb768a-a886-4cda-ac31-f376e6c76b61]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[702d3b5d-2829-4f0e-9f4a-401a4b4c977e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260]
Nov 21 14:30:09 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260] successful.
Nov 21 14:30:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e53af2-a285-4ed4-a530-68b14b7ed02c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed28a26-72af-4c82-9b34-333158cc49d3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:09 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:09 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[43586706-9de7-4ca6-bdae-51c7f69c750b]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:09 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:30:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:30:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuoHDLez', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:30:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23531663132393064', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531663132393064', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:30:10 user nova-compute[74882]: DEBUG nova.objects.instance [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid d61339ed-84db-4f60-8d64-292749322a77 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:30:10 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:10 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:30:10 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:10 user nova-compute[74882]:   <serial>fdd1dfae-2be0-484c-87b7-2e0474ee9287</serial>
Nov 21 14:30:10 user nova-compute[74882]: </disk>
Nov 21 14:30:10 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:30:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] No VIF found with MAC fa:16:3e:d6:8e:52, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:30:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-947af378-925d-4d9f-a77a-427fe150fc8b tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.074s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:12 user nova-compute[74882]: INFO nova.compute.manager [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Detaching volume fdd1dfae-2be0-484c-87b7-2e0474ee9287
Nov 21 14:30:12 user nova-compute[74882]: INFO nova.virt.block_device [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Attempting to driver detach volume fdd1dfae-2be0-484c-87b7-2e0474ee9287 from mountpoint /dev/vdb
Nov 21 14:30:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Attempting to detach device vdb from instance d61339ed-84db-4f60-8d64-292749322a77 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:30:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:30:12 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:12 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:30:12 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:12 user nova-compute[74882]:   <serial>fdd1dfae-2be0-484c-87b7-2e0474ee9287</serial>
Nov 21 14:30:12 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:30:12 user nova-compute[74882]: </disk>
Nov 21 14:30:12 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:30:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully detached device vdb from instance d61339ed-84db-4f60-8d64-292749322a77 from the persistent domain config.
Nov 21 14:30:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d61339ed-84db-4f60-8d64-292749322a77 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:30:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:30:12 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:12 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:30:12 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:12 user nova-compute[74882]:   <serial>fdd1dfae-2be0-484c-87b7-2e0474ee9287</serial>
Nov 21 14:30:12 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:30:12 user nova-compute[74882]: </disk>
Nov 21 14:30:12 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:30:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d61339ed-84db-4f60-8d64-292749322a77 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:30:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:30:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:30:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:30:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:30:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-changed-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Refreshing instance network info cache due to event network-changed-b08c806e-bd8a-4ff2-9e57-7e282ee74121. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Acquiring lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Acquired lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Refreshing network info cache for port b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updated VIF entry in instance network info cache for port b08c806e-bd8a-4ff2-9e57-7e282ee74121. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG nova.network.neutron [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updating instance_info_cache with network_info: [{"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:30:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cde08a7c-3d57-4cdc-ab97-38ce51f0d27f req-eaca2532-844a-4186-8377-6cd411d1f577 service nova] Releasing lock "refresh_cache-bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:30:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:22 user nova-compute[74882]: INFO nova.compute.manager [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Attaching volume 4a599266-ce68-4b30-832f-252213f580c3 to /dev/vdb
Nov 21 14:30:22 user nova-compute[74882]: DEBUG os_brick.utils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0d1ca5-885a-4c8d-9701-e0cc9bc895f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5434eb7b-5d04-486a-9e84-074576634b9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd83774c-8c3e-49fd-8da0-79ac7bbec27b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[06785422-c2e2-4651-ad6b-61ca23af8039]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:22 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:30:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2739ee-4b9a-4fb4-ad95-11d2112e5b3f]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG os_brick.utils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:22 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updating existing volume attachment record: 9c91d716-975f-41f2-beec-c9b91127f629 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:30:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "24342449-c859-4f3d-a215-4f1930a612b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "24342449-c859-4f3d-a215-4f1930a612b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "24342449-c859-4f3d-a215-4f1930a612b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:28 user nova-compute[74882]: INFO nova.compute.manager [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Terminating instance
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received event network-vif-unplugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Acquiring lock "24342449-c859-4f3d-a215-4f1930a612b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] No waiting events found dispatching network-vif-unplugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-f09edfed-4ecb-4c2d-a6fd-368fd80d7e83 req-64285c9b-fa59-422a-8b6d-4f781586be6c service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received event network-vif-unplugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZbCAqNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:28 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:28 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:28 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e57e48b-1a15-4b32-bbb0-76901a873ba4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:30:28 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff6838d-4238-4b9e-8adc-c6e037d1bcc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3] added
Nov 21 14:30:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86e7246-61d0-4672-9f45-08b623b57d2b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b8a06a-b5a2-431b-9c60-b22ea6bd4cd8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZbCAqNW {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZbCAqNW" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fd2a4b-0d11-4e11-a4e1-ecb2c7c89310]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZbCAqNW'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ddce8-c559-4815-952e-815a606871b7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ea334-0353-4245-bbe6-7e1ea44ee1dc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:28 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:28 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:28 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:28 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:28 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:28 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Instance destroyed successfully.
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lazy-loading 'resources' on Instance uuid 24342449-c859-4f3d-a215-4f1930a612b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1394546310',display_name='tempest-VolumesNegativeTest-instance-1394546310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1394546310',id=26,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='357e5035226846ffac018b95ba6a9853',ramdisk_id='',reservation_id='r-b7zo3wtg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1253096034',owner_user_name='tempest-VolumesNegativeTest-1253096034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:28:47Z,user_data=None,user_id='e026bd9694a247cdab93467d43b9f57b',uuid=24342449-c859-4f3d-a215-4f1930a612b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Converting VIF {"id": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "address": "fa:16:3e:94:d3:c9", "network": {"id": "17e1fb9e-1064-4618-99d2-831fb9cd6d49", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c0cde27a75e6492fba3c45c9054a2c4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0918391-3b", "ovs_interfaceid": "c0918391-3bbd-4d9a-9ffe-e5eb3402554f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d3:c9,bridge_name='br-int',has_traffic_filtering=True,id=c0918391-3bbd-4d9a-9ffe-e5eb3402554f,network=Network(17e1fb9e-1064-4618-99d2-831fb9cd6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0918391-3b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_vif [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d3:c9,bridge_name='br-int',has_traffic_filtering=True,id=c0918391-3bbd-4d9a-9ffe-e5eb3402554f,network=Network(17e1fb9e-1064-4618-99d2-831fb9cd6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0918391-3b') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0918391-3b, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c5469ef-07cf-47fc-959d-cae180afd35c) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:30:28 user nova-compute[74882]: INFO os_vif [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d3:c9,bridge_name='br-int',has_traffic_filtering=True,id=c0918391-3bbd-4d9a-9ffe-e5eb3402554f,network=Network(17e1fb9e-1064-4618-99d2-831fb9cd6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0918391-3b')
Nov 21 14:30:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Deleting instance files /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9_del
Nov 21 14:30:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Deletion of /opt/stack/data/nova/instances/24342449-c859-4f3d-a215-4f1930a612b9_del complete
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2e5add-9c9b-427c-9a3e-aa2f8545f5f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260]
Nov 21 14:30:28 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260] successful.
Nov 21 14:30:28 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4a373-7c0d-4175-b0f0-b3a83157c567]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd6218-e2ed-4871-8c84-8abd7253cdaf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:29 user nova-compute[74882]: INFO nova.compute.manager [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0012b229-4afa-4b31-b308-bac5b3cd00c3]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:30:29 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Took 0.43 seconds to deallocate network for instance.
Nov 21 14:30:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-42174e5f-35af-4a4e-8caa-2a6561198879 req-8a03d815-9ebb-4269-979e-e9c5fd8e9363 service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received event network-vif-deleted-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:30:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:29 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Deleted allocations for instance 24342449-c859-4f3d-a215-4f1930a612b9
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a8fafb0c-453c-47e3-a982-1561fbe1c34b tempest-VolumesNegativeTest-1253096034 tempest-VolumesNegativeTest-1253096034-project-member] Lock "24342449-c859-4f3d-a215-4f1930a612b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZbCAqNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23835366662346639', 'path': '/dev/sdf'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835366662346639', 'path': '/dev/sdf'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:30:30 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:30 user nova-compute[74882]:   <source dev="/dev/sdf"/>
Nov 21 14:30:30 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:30 user nova-compute[74882]:   <serial>4a599266-ce68-4b30-832f-252213f580c3</serial>
Nov 21 14:30:30 user nova-compute[74882]: </disk>
Nov 21 14:30:30 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No VIF found with MAC fa:16:3e:ae:e1:17, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received event network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Acquiring lock "24342449-c859-4f3d-a215-4f1930a612b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] Lock "24342449-c859-4f3d-a215-4f1930a612b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] No waiting events found dispatching network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:30:30 user nova-compute[74882]: WARNING nova.compute.manager [req-d7b6a63a-ecf2-4693-bca8-ea0e0a103f36 req-64ea1120-71fb-4026-8a8b-fa590b46a12d service nova] [instance: 24342449-c859-4f3d-a215-4f1930a612b9] Received unexpected event network-vif-plugged-c0918391-3bbd-4d9a-9ffe-e5eb3402554f for instance with vm_state deleted and task_state None.
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "8982cace-751d-41d6-9131-561f6b55ca54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "8982cace-751d-41d6-9131-561f6b55ca54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "8982cace-751d-41d6-9131-561f6b55ca54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:30 user nova-compute[74882]: INFO nova.compute.manager [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Terminating instance
Nov 21 14:30:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e1c748ae-a2b8-4bbf-ac30-26a19287e64d tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.494s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Instance destroyed successfully.
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.objects.instance [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lazy-loading 'resources' on Instance uuid 8982cace-751d-41d6-9131-561f6b55ca54 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1129360862',display_name='tempest-VolumesActionsTest-instance-1129360862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1129360862',id=27,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a42118796db243d7a72988931f9915fc',ramdisk_id='',reservation_id='r-7ifgx8hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1401937880',owner_user_name='tempest-VolumesActionsTest-1401937880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:28:48Z,user_data=None,user_id='a95c719f033946038ed21c53704577b1',uuid=8982cace-751d-41d6-9131-561f6b55ca54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converting VIF {"id": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "address": "fa:16:3e:6e:97:8f", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap630cdcfd-f6", "ovs_interfaceid": "630cdcfd-f631-4d1b-8d7d-a0706074f1bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:8f,bridge_name='br-int',has_traffic_filtering=True,id=630cdcfd-f631-4d1b-8d7d-a0706074f1bb,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630cdcfd-f6') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG os_vif [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:8f,bridge_name='br-int',has_traffic_filtering=True,id=630cdcfd-f631-4d1b-8d7d-a0706074f1bb,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630cdcfd-f6') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap630cdcfd-f6, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5552041f-eca9-43f5-8dc2-7709dc98f7c5) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:31 user nova-compute[74882]: INFO os_vif [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:8f,bridge_name='br-int',has_traffic_filtering=True,id=630cdcfd-f631-4d1b-8d7d-a0706074f1bb,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap630cdcfd-f6')
Nov 21 14:30:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Deleting instance files /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54_del
Nov 21 14:30:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Deletion of /opt/stack/data/nova/instances/8982cace-751d-41d6-9131-561f6b55ca54_del complete
Nov 21 14:30:31 user nova-compute[74882]: INFO nova.compute.manager [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 21 14:30:31 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received event network-vif-unplugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Acquiring lock "8982cace-751d-41d6-9131-561f6b55ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] No waiting events found dispatching network-vif-unplugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received event network-vif-unplugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received event network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Acquiring lock "8982cace-751d-41d6-9131-561f6b55ca54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] Lock "8982cace-751d-41d6-9131-561f6b55ca54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] No waiting events found dispatching network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:30:31 user nova-compute[74882]: WARNING nova.compute.manager [req-6a74765c-0117-4b64-8628-7cef1c20fa1f req-68ddd6a1-72f5-451c-b337-ce9f2cae2274 service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received unexpected event network-vif-plugged-630cdcfd-f631-4d1b-8d7d-a0706074f1bb for instance with vm_state active and task_state deleting.
Nov 21 14:30:32 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:30:32 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Took 0.63 seconds to deallocate network for instance.
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:32 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Deleted allocations for instance 8982cace-751d-41d6-9131-561f6b55ca54
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-848f6d0a-9514-4b5b-a958-1fa24122e841 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "8982cace-751d-41d6-9131-561f6b55ca54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.862s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d61339ed-84db-4f60-8d64-292749322a77 is timed out.
Nov 21 14:30:32 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully detached device vdb from instance d61339ed-84db-4f60-8d64-292749322a77 from the live domain config.
Nov 21 14:30:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KuoHDLez', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:32 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d06e32-6384-435d-8e5d-90d67af892af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:30:32 user nova-compute[74882]: No targets found.
Nov 21 14:30:32 user nova-compute[74882]: iSNS:
Nov 21 14:30:32 user nova-compute[74882]: No targets found.
Nov 21 14:30:32 user nova-compute[74882]: STATIC:
Nov 21 14:30:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:30:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:30:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f
Nov 21 14:30:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287
Nov 21 14:30:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:32 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3
Nov 21 14:30:32 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:30:32 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:30:32 user nova-compute[74882]: FIRMWARE:
Nov 21 14:30:32 user nova-compute[74882]: No targets found.
Nov 21 14:30:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:30:32 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:30:32 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf297fac-be13-4f56-b9f2-0915e1f43532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f95903-194a-4b32-b125-9bdbc786eb5f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6b0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba593c4-df60-4de0-b39c-c5834c344ff6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7289e1e-eedb-4edf-81a8-a4300bf5fdf4]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecbec74-f305-4b12-8f16-a7111ee62d37]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a886a47-563c-4a45-877b-59d8a46002bb]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a416e0b3-15a2-4d7b-946a-ab9a272fba02]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77f1dab-d1c4-489f-a4ef-1814df72c05b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260]
Nov 21 14:30:32 user nova-compute[74882]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287, portal: 172.16.0.220,3260] successful.
Nov 21 14:30:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdd1dfae-2be0-484c-87b7-2e0474ee9287 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[21643925-7386-4d67-b8a6-3c0feee82b99]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] <== disconnect_volume: return (305ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'flavor' on Instance uuid d61339ed-84db-4f60-8d64-292749322a77 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-f55313a4-3cbe-4436-9317-0c836c7dd6fa req-82215248-582f-41b1-8f0a-94eae33f30d8 service nova] [instance: 8982cace-751d-41d6-9131-561f6b55ca54] Received event network-vif-deleted-630cdcfd-f631-4d1b-8d7d-a0706074f1bb {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4fc69409-c0df-4cee-b882-e540dac62336 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:33 user nova-compute[74882]: INFO nova.compute.manager [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Attaching volume 9e790cd0-0035-41f3-bdd9-975c7d9392e1 to /dev/vdc
Nov 21 14:30:33 user nova-compute[74882]: DEBUG os_brick.utils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c05a41-444e-455c-8672-049387bcaf74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c48dc-4adc-4f50-8d91-fae166eadf41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff214d99-f55d-48e9-bc8e-16dbc94544d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8812f412-4a8d-4d2e-ab46-8fe1a03a7da7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:34 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d853f7d-6bef-4cfd-8db5-ef200efbf9d5]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG os_brick.utils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updating existing volume attachment record: aaf67318-76f7-47d7-8432-4924f023f73d {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:30:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7418MB free_disk=25.243839263916016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance d61339ed-84db-4f60-8d64-292749322a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:30:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:39 user nova-compute[74882]: INFO nova.compute.manager [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attaching volume 6862794e-0a01-4d78-97e8-37855fda7acd to /dev/vdb
Nov 21 14:30:39 user nova-compute[74882]: DEBUG os_brick.utils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc5e890-f368-4c38-8313-3d5662c778f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d679a2-bc97-4093-9dff-3b01db82c1af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[296a5e80-600c-4492-81ad-6e16e1855d1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd9838d-9960-4c35-ae81-2115e1728f1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:30:39 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:30:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1481f50-e41f-42e6-bd8d-8a271f04052b]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG os_brick.utils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:39 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating existing volume attachment record: 2718db55-6221-4371-a2ae-bc834a4abee3 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epuKrOcN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:40 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:40 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:40 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa690e1-ac51-41f9-94b0-8bd2dfa69e56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:30:40 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[635cbb08-0574-47e4-a076-743b55fddb99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1] added
Nov 21 14:30:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[020333cf-ec89-45ea-a2e1-0975645a3cbf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a598275-a45f-4821-bb76-211698305725]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epuKrOcN {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epuKrOcN" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eeeaf2-5965-4e76-87af-f2258d3288ca]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epuKrOcN'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f5a6ff-d7b2-482c-bcdb-eb9314c08c20]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a74d43-21b8-4b47-a42e-3ec7b5b11a6a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5857d23-f862-4d9b-86b1-dba9bfe890f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260]
Nov 21 14:30:40 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260] successful.
Nov 21 14:30:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0e2209-d6e5-44bb-99b0-9d0f8e113e89]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3d7538-cac6-48c8-a405-92ed49ecb657]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:30:40 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7ccf2-21c9-4654-a599-c189cd69394e]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epuKrOcN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26266353034346664', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266353034346664', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:30:41 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:41 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:30:41 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:30:41 user nova-compute[74882]:   <serial>9e790cd0-0035-41f3-bdd9-975c7d9392e1</serial>
Nov 21 14:30:41 user nova-compute[74882]: </disk>
Nov 21 14:30:41 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:30:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] No VIF found with MAC fa:16:3e:ae:e1:17, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:30:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ba4c3b1c-3bfd-4b20-bf71-66fd8cbb6a12 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.308s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:43 user nova-compute[74882]: INFO nova.compute.manager [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Detaching volume 4a599266-ce68-4b30-832f-252213f580c3
Nov 21 14:30:43 user nova-compute[74882]: INFO nova.virt.block_device [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Attempting to driver detach volume 4a599266-ce68-4b30-832f-252213f580c3 from mountpoint /dev/vdb
Nov 21 14:30:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Attempting to detach device vdb from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:30:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:30:43 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:43 user nova-compute[74882]:   <source dev="/dev/sdf"/>
Nov 21 14:30:43 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:43 user nova-compute[74882]:   <serial>4a599266-ce68-4b30-832f-252213f580c3</serial>
Nov 21 14:30:43 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:30:43 user nova-compute[74882]: </disk>
Nov 21 14:30:43 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:30:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully detached device vdb from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the persistent domain config.
Nov 21 14:30:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:30:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:30:43 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:43 user nova-compute[74882]:   <source dev="/dev/sdf"/>
Nov 21 14:30:43 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:43 user nova-compute[74882]:   <serial>4a599266-ce68-4b30-832f-252213f580c3</serial>
Nov 21 14:30:43 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:30:43 user nova-compute[74882]: </disk>
Nov 21 14:30:43 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:30:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:30:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:44 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:30:45 user nova-compute[74882]: INFO nova.compute.claims [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Claim successful on node user
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:30:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.policy [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:30:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Creating image(s)
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'migsnZJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:30:46 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:46 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:30:46 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4db07f7-32c7-48fd-90ef-b5113b55f39b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:30:46 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b38d52-2634-4058-8581-c0f4e4d7317a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd] added
Nov 21 14:30:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk 1073741824" returned: 0 in 0.049s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f673906-2e55-4141-b40c-d5e37f907b60]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[692fc4c2-65d0-4310-a0da-3a7b11944153]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v migsnZJD {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v migsnZJD" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7a7931-d64b-452d-9721-10ddc19c1ad0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'migsnZJD'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f707b16-c8d6-4b51-a942-2a5a744827c2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Successfully created port: 6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e807fe38-9885-41a2-9e92-b2932ccbfc17]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.201s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c447ab-57f4-4ed2-9a3d-54389e1346a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260]
Nov 21 14:30:46 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260] successful.
Nov 21 14:30:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e7dfa-27b4-40bf-9a96-02132bf5d14b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc268e6-f51c-4c59-9508-e22560448cc0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:30:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:30:46 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:30:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[316896f3-4c26-4933-af1a-f29c94034107]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'migsnZJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Cannot resize image /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Ensure instance console log exists: /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Successfully updated port: 6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received event network-changed-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Refreshing instance network info cache due to event network-changed-6b5cbded-889d-4a11-a500-ce0bc10fdfa0. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:30:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Acquiring lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Updating instance_info_cache with network_info: [{"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Instance network_info: |[{"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Acquired lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Refreshing network info cache for port 6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Start _get_guest_xml network_info=[{"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:30:47 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:30:47 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1454925154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1454925154',id=31,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-4pfzfj11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:30:46Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=5a754e62-be65-4faa-a27c-0e4f3b02c842,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f4:9e,bridge_name='br-int',has_traffic_filtering=True,id=6b5cbded-889d-4a11-a500-ce0bc10fdfa0,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5cbded-88') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a754e62-be65-4faa-a27c-0e4f3b02c842 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:30:47 user nova-compute[74882]:   <uuid>5a754e62-be65-4faa-a27c-0e4f3b02c842</uuid>
Nov 21 14:30:47 user nova-compute[74882]:   <name>instance-0000001f</name>
Nov 21 14:30:47 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:30:47 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:30:47 user nova-compute[74882]:   <metadata>
Nov 21 14:30:47 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:30:47 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:30:47 user nova-compute[74882]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1454925154</nova:name>
Nov 21 14:30:47 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:30:47</nova:creationTime>
Nov 21 14:30:47 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:30:47 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:30:47 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:30:47 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:30:47 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:30:47 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:30:47 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:30:47 user nova-compute[74882]:       <nova:owner>
Nov 21 14:30:47 user nova-compute[74882]:         <nova:user uuid="7635b3029cf14950a1978282d06bc8f3">tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member</nova:user>
Nov 21 14:30:47 user nova-compute[74882]:         <nova:project uuid="96e5113ec65d46c4b8859c4658433b02">tempest-ServerBootFromVolumeStableRescueTest-1086017756</nova:project>
Nov 21 14:30:47 user nova-compute[74882]:       </nova:owner>
Nov 21 14:30:47 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:30:47 user nova-compute[74882]:       <nova:ports>
Nov 21 14:30:47 user nova-compute[74882]:         <nova:port uuid="6b5cbded-889d-4a11-a500-ce0bc10fdfa0">
Nov 21 14:30:47 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 21 14:30:47 user nova-compute[74882]:         </nova:port>
Nov 21 14:30:47 user nova-compute[74882]:       </nova:ports>
Nov 21 14:30:47 user nova-compute[74882]:     </nova:instance>
Nov 21 14:30:47 user nova-compute[74882]:   </metadata>
Nov 21 14:30:47 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:30:47 user nova-compute[74882]:     <system>
Nov 21 14:30:47 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:30:47 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:30:47 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:30:47 user nova-compute[74882]:       <entry name="serial">5a754e62-be65-4faa-a27c-0e4f3b02c842</entry>
Nov 21 14:30:47 user nova-compute[74882]:       <entry name="uuid">5a754e62-be65-4faa-a27c-0e4f3b02c842</entry>
Nov 21 14:30:47 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:30:47 user nova-compute[74882]:     </system>
Nov 21 14:30:47 user nova-compute[74882]:   </sysinfo>
Nov 21 14:30:47 user nova-compute[74882]:   <os>
Nov 21 14:30:47 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:30:47 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:30:47 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:30:47 user nova-compute[74882]:   </os>
Nov 21 14:30:47 user nova-compute[74882]:   <features>
Nov 21 14:30:47 user nova-compute[74882]:     <acpi/>
Nov 21 14:30:47 user nova-compute[74882]:     <apic/>
Nov 21 14:30:47 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:30:47 user nova-compute[74882]:   </features>
Nov 21 14:30:47 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:30:47 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:30:47 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:30:47 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:30:47 user nova-compute[74882]:   </clock>
Nov 21 14:30:47 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:30:47 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:30:47 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:30:47 user nova-compute[74882]:   </cpu>
Nov 21 14:30:47 user nova-compute[74882]:   <devices>
Nov 21 14:30:47 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:30:47 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:30:47 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk"/>
Nov 21 14:30:47 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:30:47 user nova-compute[74882]:     </disk>
Nov 21 14:30:47 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:30:47 user nova-compute[74882]:       <mac address="fa:16:3e:d0:f4:9e"/>
Nov 21 14:30:47 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:30:47 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:30:47 user nova-compute[74882]:       <target dev="tap6b5cbded-88"/>
Nov 21 14:30:47 user nova-compute[74882]:     </interface>
Nov 21 14:30:47 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:30:47 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/console.log" append="off"/>
Nov 21 14:30:47 user nova-compute[74882]:     </serial>
Nov 21 14:30:47 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:30:47 user nova-compute[74882]:     <video>
Nov 21 14:30:47 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:30:47 user nova-compute[74882]:     </video>
Nov 21 14:30:47 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:30:47 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:30:47 user nova-compute[74882]:     </rng>
Nov 21 14:30:47 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:30:47 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:30:47 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:30:47 user nova-compute[74882]:     </memballoon>
Nov 21 14:30:47 user nova-compute[74882]:   </devices>
Nov 21 14:30:47 user nova-compute[74882]: </domain>
Nov 21 14:30:47 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1454925154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1454925154',id=31,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-4pfzfj11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:30:46Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=5a754e62-be65-4faa-a27c-0e4f3b02c842,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f4:9e,bridge_name='br-int',has_traffic_filtering=True,id=6b5cbded-889d-4a11-a500-ce0bc10fdfa0,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5cbded-88') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG os_vif [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f4:9e,bridge_name='br-int',has_traffic_filtering=True,id=6b5cbded-889d-4a11-a500-ce0bc10fdfa0,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5cbded-88') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b94f8b55-a71e-57c2-a732-d013c15cce93', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b5cbded-88, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b5cbded-88, col_values=(('qos', UUID('0425e85b-98e6-4abd-a9e8-b972dca70dc9')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b5cbded-88, col_values=(('external_ids', {'iface-id': '6b5cbded-889d-4a11-a500-ce0bc10fdfa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:f4:9e', 'vm-uuid': '5a754e62-be65-4faa-a27c-0e4f3b02c842'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23165626231313433', 'path': '/dev/sdg'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165626231313433', 'path': '/dev/sdg'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:47 user nova-compute[74882]: INFO os_vif [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:f4:9e,bridge_name='br-int',has_traffic_filtering=True,id=6b5cbded-889d-4a11-a500-ce0bc10fdfa0,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5cbded-88')
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:30:47 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:47 user nova-compute[74882]:   <source dev="/dev/sdg"/>
Nov 21 14:30:47 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:47 user nova-compute[74882]:   <serial>6862794e-0a01-4d78-97e8-37855fda7acd</serial>
Nov 21 14:30:47 user nova-compute[74882]: </disk>
Nov 21 14:30:47 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No VIF found with MAC fa:16:3e:d0:f4:9e, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Updated VIF entry in instance network info cache for port 6b5cbded-889d-4a11-a500-ce0bc10fdfa0. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Updating instance_info_cache with network_info: [{"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4b1a9151-5907-48f7-b9b7-e16492b9f485 req-47e612e1-bcd9-4ce0-a594-d68a39b7e589 service nova] Releasing lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:30:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] No VIF found with MAC fa:16:3e:c5:66:55, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:30:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a2d4dc3e-4ecf-49d2-acb3-5707cdb72395 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.354s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received event network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] No waiting events found dispatching network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:30:49 user nova-compute[74882]: WARNING nova.compute.manager [req-b8b2ba67-b1b5-40fd-8a34-91a354100d3d req-9536730a-a2af-4adc-9c84-fe90acb1378d service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received unexpected event network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance with vm_state building and task_state spawning.
Nov 21 14:30:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:49 user nova-compute[74882]: INFO nova.compute.manager [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Detaching volume 6862794e-0a01-4d78-97e8-37855fda7acd
Nov 21 14:30:49 user nova-compute[74882]: INFO nova.virt.block_device [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Attempting to driver detach volume 6862794e-0a01-4d78-97e8-37855fda7acd from mountpoint /dev/vdb
Nov 21 14:30:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Attempting to detach device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:30:49 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:49 user nova-compute[74882]:   <source dev="/dev/sdg"/>
Nov 21 14:30:49 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:49 user nova-compute[74882]:   <serial>6862794e-0a01-4d78-97e8-37855fda7acd</serial>
Nov 21 14:30:49 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:30:49 user nova-compute[74882]: </disk>
Nov 21 14:30:49 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:30:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the persistent domain config.
Nov 21 14:30:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:30:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:30:49 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:30:49 user nova-compute[74882]:   <source dev="/dev/sdg"/>
Nov 21 14:30:49 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:30:49 user nova-compute[74882]:   <serial>6862794e-0a01-4d78-97e8-37855fda7acd</serial>
Nov 21 14:30:49 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:30:49 user nova-compute[74882]: </disk>
Nov 21 14:30:49 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:30:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:30:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Instance spawned successfully.
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received event network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] No waiting events found dispatching network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:30:51 user nova-compute[74882]: WARNING nova.compute.manager [req-62b00e93-c2ac-439c-acef-333b87a2f7ec req-f5d570e3-9818-4271-bf3d-fc6c0f7cc3d8 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received unexpected event network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance with vm_state building and task_state spawning.
Nov 21 14:30:51 user nova-compute[74882]: INFO nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 21 14:30:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:30:51 user nova-compute[74882]: INFO nova.compute.manager [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Took 6.39 seconds to build instance.
Nov 21 14:30:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c03baf46-c8ad-451b-a73a-4ee1c82bcbbe tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.482s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:30:58 user nova-compute[74882]: INFO nova.compute.manager [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Rescuing
Nov 21 14:30:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:30:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:30:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updating instance_info_cache with network_info: [{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-unplugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-unplugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:30:59 user nova-compute[74882]: WARNING nova.compute.manager [req-a8135aab-0599-430d-a0f5-5b2da4dc4366 req-76a7186c-8566-4dba-b4fd-3333dc771714 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received unexpected event network-vif-unplugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with vm_state active and task_state rescuing.
Nov 21 14:30:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:30:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance destroyed successfully.
Nov 21 14:31:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Attempting rescue
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74882) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:31:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Creating image(s)
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'trusted_certs' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue" returned: 0 in 0.047s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'migration_context' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.base [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<ebf25b5a-9531-4058-8e86-372fef1517e0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Start _get_guest_xml network_info=[{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:bc:e3:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'resources' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.base [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<ebf25b5a-9531-4058-8e86-372fef1517e0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'numa_topology' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.base [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<ebf25b5a-9531-4058-8e86-372fef1517e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:31:00 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:00 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'vcpu_model' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.base [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<ebf25b5a-9531-4058-8e86-372fef1517e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-71590957',display_name='tempest-ServerRescueNegativeTestJSON-server-71590957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-71590957',id=29,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5kn0lgrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:17Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=ebf25b5a-9531-4058-8e86-372fef1517e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:bc:e3:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:bc:e3:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'pci_devices' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.objects.base [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<ebf25b5a-9531-4058-8e86-372fef1517e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:31:00 user nova-compute[74882]:   <uuid>ebf25b5a-9531-4058-8e86-372fef1517e0</uuid>
Nov 21 14:31:00 user nova-compute[74882]:   <name>instance-0000001d</name>
Nov 21 14:31:00 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:31:00 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:31:00 user nova-compute[74882]:   <metadata>
Nov 21 14:31:00 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:31:00 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:31:00 user nova-compute[74882]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-71590957</nova:name>
Nov 21 14:31:00 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:31:00</nova:creationTime>
Nov 21 14:31:00 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:31:00 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:31:00 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:31:00 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:31:00 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:31:00 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:31:00 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:31:00 user nova-compute[74882]:       <nova:owner>
Nov 21 14:31:00 user nova-compute[74882]:         <nova:user uuid="4b8ebb88fee544a793fd71ebeee0845f">tempest-ServerRescueNegativeTestJSON-2007417611-project-member</nova:user>
Nov 21 14:31:00 user nova-compute[74882]:         <nova:project uuid="e50c445b6ade47c09380da2248cf5954">tempest-ServerRescueNegativeTestJSON-2007417611</nova:project>
Nov 21 14:31:00 user nova-compute[74882]:       </nova:owner>
Nov 21 14:31:00 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:31:00 user nova-compute[74882]:       <nova:ports>
Nov 21 14:31:00 user nova-compute[74882]:         <nova:port uuid="2076301e-56e7-4d67-90db-192335b0f56c">
Nov 21 14:31:00 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 21 14:31:00 user nova-compute[74882]:         </nova:port>
Nov 21 14:31:00 user nova-compute[74882]:       </nova:ports>
Nov 21 14:31:00 user nova-compute[74882]:     </nova:instance>
Nov 21 14:31:00 user nova-compute[74882]:   </metadata>
Nov 21 14:31:00 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:31:00 user nova-compute[74882]:     <system>
Nov 21 14:31:00 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:31:00 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:31:00 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:31:00 user nova-compute[74882]:       <entry name="serial">ebf25b5a-9531-4058-8e86-372fef1517e0</entry>
Nov 21 14:31:00 user nova-compute[74882]:       <entry name="uuid">ebf25b5a-9531-4058-8e86-372fef1517e0</entry>
Nov 21 14:31:00 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:31:00 user nova-compute[74882]:     </system>
Nov 21 14:31:00 user nova-compute[74882]:   </sysinfo>
Nov 21 14:31:00 user nova-compute[74882]:   <os>
Nov 21 14:31:00 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:31:00 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:31:00 user nova-compute[74882]:   </os>
Nov 21 14:31:00 user nova-compute[74882]:   <features>
Nov 21 14:31:00 user nova-compute[74882]:     <acpi/>
Nov 21 14:31:00 user nova-compute[74882]:     <apic/>
Nov 21 14:31:00 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:31:00 user nova-compute[74882]:   </features>
Nov 21 14:31:00 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:31:00 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:31:00 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:31:00 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:31:00 user nova-compute[74882]:   </clock>
Nov 21 14:31:00 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:31:00 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:31:00 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:31:00 user nova-compute[74882]:   </cpu>
Nov 21 14:31:00 user nova-compute[74882]:   <devices>
Nov 21 14:31:00 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:31:00 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:31:00 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue"/>
Nov 21 14:31:00 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:31:00 user nova-compute[74882]:     </disk>
Nov 21 14:31:00 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:31:00 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:31:00 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk"/>
Nov 21 14:31:00 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:31:00 user nova-compute[74882]:     </disk>
Nov 21 14:31:00 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:31:00 user nova-compute[74882]:       <mac address="fa:16:3e:bc:e3:29"/>
Nov 21 14:31:00 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:31:00 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:31:00 user nova-compute[74882]:       <target dev="tap2076301e-56"/>
Nov 21 14:31:00 user nova-compute[74882]:     </interface>
Nov 21 14:31:00 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:31:00 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/console.log" append="off"/>
Nov 21 14:31:00 user nova-compute[74882]:     </serial>
Nov 21 14:31:00 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:31:00 user nova-compute[74882]:     <video>
Nov 21 14:31:00 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:31:00 user nova-compute[74882]:     </video>
Nov 21 14:31:00 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:31:00 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:31:00 user nova-compute[74882]:     </rng>
Nov 21 14:31:00 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:31:00 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:31:00 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:31:00 user nova-compute[74882]:     </memballoon>
Nov 21 14:31:00 user nova-compute[74882]:   </devices>
Nov 21 14:31:00 user nova-compute[74882]: </domain>
Nov 21 14:31:00 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:31:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance destroyed successfully.
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:31:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No VIF found with MAC fa:16:3e:bc:e3:29, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:31:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:01 user nova-compute[74882]: WARNING nova.compute.manager [req-4a2de304-af43-435f-82db-e418250cc9ee req-40887489-ee3e-46b6-8270-d98fee581fa0 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received unexpected event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with vm_state active and task_state rescuing.
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:02 user nova-compute[74882]: INFO nova.compute.manager [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Terminating instance
Nov 21 14:31:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: d61339ed-84db-4f60-8d64-292749322a77] Instance destroyed successfully.
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lazy-loading 'resources' on Instance uuid d61339ed-84db-4f60-8d64-292749322a77 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-273719294',display_name='tempest-AttachVolumeNegativeTest-server-273719294',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-273719294',id=24,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2LK5wibZIOBbPogA8ShMLJsBp29tS9U/yH2c8rOMZPif+igCe47OOPKt9Q4MqgvofUlhEeB2RyAkIQVGobhUH7J4eg1rL+SoPrAdzSsdyoiGkMsQuAbudPcqZMW8sr3w==',key_name='tempest-keypair-740459586',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dadaa9830cd54eb09daee40d952be38f',ramdisk_id='',reservation_id='r-joqfkbm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1777808809',owner_user_name='tempest-AttachVolumeNegativeTest-1777808809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d55abe8426b34d10b31ff6b0aefddd37',uuid=d61339ed-84db-4f60-8d64-292749322a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converting VIF {"id": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "address": "fa:16:3e:d6:8e:52", "network": {"id": "3ee5933d-610e-4e1b-91f4-1b2cceb04f87", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-510039976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dadaa9830cd54eb09daee40d952be38f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2e47e55-e8", "ovs_interfaceid": "a2e47e55-e8fc-4acc-94b2-affe7175312f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=a2e47e55-e8fc-4acc-94b2-affe7175312f,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e47e55-e8') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_vif [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=a2e47e55-e8fc-4acc-94b2-affe7175312f,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e47e55-e8') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2e47e55-e8, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=977eea50-dbe1-431f-960d-8d0fbc220f23) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:03 user nova-compute[74882]: INFO os_vif [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:8e:52,bridge_name='br-int',has_traffic_filtering=True,id=a2e47e55-e8fc-4acc-94b2-affe7175312f,network=Network(3ee5933d-610e-4e1b-91f4-1b2cceb04f87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2e47e55-e8')
Nov 21 14:31:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Deleting instance files /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77_del
Nov 21 14:31:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Deletion of /opt/stack/data/nova/instances/d61339ed-84db-4f60-8d64-292749322a77_del complete
Nov 21 14:31:03 user nova-compute[74882]: INFO nova.compute.manager [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] [instance: d61339ed-84db-4f60-8d64-292749322a77] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: d61339ed-84db-4f60-8d64-292749322a77] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: d61339ed-84db-4f60-8d64-292749322a77] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:31:03 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 is timed out.
Nov 21 14:31:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully detached device vdb from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the live domain config.
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZbCAqNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:31:03 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[583cf4bc-3b8f-488a-94ae-fd2e317a77e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:31:03 user nova-compute[74882]: No targets found.
Nov 21 14:31:03 user nova-compute[74882]: iSNS:
Nov 21 14:31:03 user nova-compute[74882]: No targets found.
Nov 21 14:31:03 user nova-compute[74882]: STATIC:
Nov 21 14:31:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:31:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd
Nov 21 14:31:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:31:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f
Nov 21 14:31:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1
Nov 21 14:31:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3
Nov 21 14:31:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:03 user nova-compute[74882]: FIRMWARE:
Nov 21 14:31:03 user nova-compute[74882]: No targets found.
Nov 21 14:31:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:31:03 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:31:03 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e4079-cd94-403d-81d2-73fec2e285d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5925e625-ef1f-4d6b-9585-6e8063c7cf9b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:31:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:03 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:31:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c1efbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3'): ({'sdf'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Removing single pathed devices sdf {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:03 user nova-compute[74882]: WARNING nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received unexpected event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with vm_state active and task_state rescuing.
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:03 user nova-compute[74882]: WARNING nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received unexpected event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with vm_state active and task_state rescuing.
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-vif-unplugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] No waiting events found dispatching network-vif-unplugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-vif-unplugged-a2e47e55-e8fc-4acc-94b2-affe7175312f for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Acquiring lock "d61339ed-84db-4f60-8d64-292749322a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] Lock "d61339ed-84db-4f60-8d64-292749322a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] No waiting events found dispatching network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:03 user nova-compute[74882]: WARNING nova.compute.manager [req-59f8bf75-2613-470f-9349-9e3944c5fd64 req-dc52ffbb-1572-485b-a19b-b4b2e49dcef3 service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received unexpected event network-vif-plugged-a2e47e55-e8fc-4acc-94b2-affe7175312f for instance with vm_state active and task_state deleting.
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fd7682-c39a-4d56-b38e-b3aa154ea5a7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6884ef-454b-44a2-950f-0feb430c99a2]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flushing IO for device /dev/sdf {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-changed-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Refreshing instance network info cache due to event network-changed-a2969955-0235-4311-83c4-3d30b0e2ac53. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Acquiring lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Acquired lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.network.neutron [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Refreshing network info cache for port a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6916865-8dbb-4087-824e-e8fdca9652b2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[961b88b8-61b3-47e7-bfd1-d2ecf82064ad]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] SCSI volumes sdf have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69c6a41-c97a-424a-83ff-bad3a933240a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c55d7ac-738c-4931-9ef6-a3ecfab5c59a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260]
Nov 21 14:31:03 user nova-compute[74882]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3, portal: 172.16.0.220,3260] successful.
Nov 21 14:31:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a599266-ce68-4b30-832f-252213f580c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc2ce98-390b-49c8-8a5a-9ccda946d891]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== disconnect_volume: return (385ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:31:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:04 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: d61339ed-84db-4f60-8d64-292749322a77] Took 0.81 seconds to deallocate network for instance.
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Received event network-vif-deleted-a2e47e55-e8fc-4acc-94b2-affe7175312f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:04 user nova-compute[74882]: INFO nova.compute.manager [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Neutron deleted interface a2e47e55-e8fc-4acc-94b2-affe7175312f; detaching it from the instance and deleting it from the info cache
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-269ac551-3cc6-450c-9ecb-fdfa43ed586b req-16abab26-eed8-4681-b527-7caa580e792c service nova] [instance: d61339ed-84db-4f60-8d64-292749322a77] Detach interface failed, port_id=a2e47e55-e8fc-4acc-94b2-affe7175312f, reason: Instance d61339ed-84db-4f60-8d64-292749322a77 could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updated VIF entry in instance network info cache for port a2969955-0235-4311-83c4-3d30b0e2ac53. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-97c2b5d8-3a64-41c9-940b-b7565a0018fd req-8a4d9501-09d3-4960-85b4-31f8777a55e1 service nova] Releasing lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f4f32d8d-1a2d-4e49-8ca0-6cc9d53e84ec tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7ed34320-5d74-4493-a689-3c663da3d393 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.880s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Stashing vm_state: active {{(pid=74882) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 21 14:31:04 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Deleted allocations for instance d61339ed-84db-4f60-8d64-292749322a77
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-31afad97-f447-40a1-abaa-a65994edb379 tempest-AttachVolumeNegativeTest-1777808809 tempest-AttachVolumeNegativeTest-1777808809-project-member] Lock "d61339ed-84db-4f60-8d64-292749322a77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.567s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:31:05 user nova-compute[74882]: INFO nova.compute.claims [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Claim successful on node user
Nov 21 14:31:05 user nova-compute[74882]: INFO nova.compute.resource_tracker [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating resource usage from migration 2a15fc7f-014b-4415-88a4-b168846e6686
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.463s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:05 user nova-compute[74882]: INFO nova.compute.manager [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Migrating
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquired lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-changed-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Refreshing instance network info cache due to event network-changed-388999f8-b374-406c-9d58-855ff9c23da8. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Acquiring lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:05 user nova-compute[74882]: INFO nova.compute.manager [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Detaching volume 9e790cd0-0035-41f3-bdd9-975c7d9392e1
Nov 21 14:31:05 user nova-compute[74882]: INFO nova.virt.block_device [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Attempting to driver detach volume 9e790cd0-0035-41f3-bdd9-975c7d9392e1 from mountpoint /dev/vdc
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Attempting to detach device vdc from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:31:05 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:31:05 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:31:05 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:31:05 user nova-compute[74882]:   <serial>9e790cd0-0035-41f3-bdd9-975c7d9392e1</serial>
Nov 21 14:31:05 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 21 14:31:05 user nova-compute[74882]: </disk>
Nov 21 14:31:05 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:31:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully detached device vdc from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the persistent domain config.
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:31:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:31:05 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:31:05 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:31:05 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:31:05 user nova-compute[74882]:   <serial>9e790cd0-0035-41f3-bdd9-975c7d9392e1</serial>
Nov 21 14:31:05 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 21 14:31:05 user nova-compute[74882]: </disk>
Nov 21 14:31:05 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating instance_info_cache with network_info: [{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Releasing lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Acquired lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.network.neutron [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Refreshing network info cache for port 388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Starting migrate_disk_and_power_off {{(pid=74882) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:06 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance destroyed successfully.
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-765597573',display_name='tempest-ServerActionsTestOtherA-server-765597573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-765597573',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:29:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-4ukk56w4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=9a6ece97-45cb-4033-8590-e97182af0a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394306484-network", "vif_mac": "fa:16:3e:c0:27:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394306484-network", "vif_mac": "fa:16:3e:c0:27:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG os_vif [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap388999f8-b3, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.network.neutron [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updated VIF entry in instance network info cache for port 388999f8-b374-406c-9d58-855ff9c23da8. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.network.neutron [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating instance_info_cache with network_info: [{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ced23c3b-7983-4afd-9f57-2dc5578774b7) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cc0868b1-6c85-431b-b116-1bb628cdf211 req-89222d32-6a9e-4d24-9852-76765e53c285 service nova] Releasing lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:31:06 user nova-compute[74882]: INFO os_vif [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3')
Nov 21 14:31:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:31:06 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:31:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:31:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG nova.compute.manager [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-unplugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG nova.compute.manager [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-unplugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:07 user nova-compute[74882]: WARNING nova.compute.manager [req-2ec1cc5c-2d3e-42a4-bc56-4aa9957e5b34 req-8a21d686-fa9d-4401-9c53-eeb632d12c45 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received unexpected event network-vif-unplugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with vm_state active and task_state resize_migrating.
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a6ae1f-1d74-4772-9049-7e2a8d7e468a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:31:07 user nova-compute[74882]: No targets found.
Nov 21 14:31:07 user nova-compute[74882]: iSNS:
Nov 21 14:31:07 user nova-compute[74882]: No targets found.
Nov 21 14:31:07 user nova-compute[74882]: STATIC:
Nov 21 14:31:07 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:31:07 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:07 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:07 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd
Nov 21 14:31:07 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:07 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:07 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:31:07 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:07 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:07 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f
Nov 21 14:31:07 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:07 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:07 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1
Nov 21 14:31:07 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:07 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:07 user nova-compute[74882]: FIRMWARE:
Nov 21 14:31:07 user nova-compute[74882]: No targets found.
Nov 21 14:31:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:31:07 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:31:07 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca80fb6e-7441-4fb5-96e8-64a05dedd0be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9889a308-0257-4c56-ad85-23814e47a47d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:31:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:07 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:31:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c446d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b566921-08bb-41a9-9e40-9b3c2108b93f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e50b3c2-779b-4cb1-975f-a7270749b91e]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadbb58e-2b18-41a3-bf58-2ef2719e4c0e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ed4cb4-98b9-44fa-8491-720f4068d057]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_21b4d472', '/dev/disk/by-id/scsi-23963343330316638', '/dev/disk/by-id/scsi-1SCST_BIO21b4d472-9c4301f886b8e541') {{(pid=85964) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fa8b1c-8c05-4828-8579-341b56ba7554]: (4, None) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8409ec-7450-463b-9b91-9cef0355701b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab2344-a43b-4ec7-94a3-ae5329abcb48]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]
Nov 21 14:31:07 user nova-compute[74882]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.
Nov 21 14:31:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b801c07-ae2f-4c1d-a3a7-bae263360ac0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== disconnect_volume: return (374ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:31:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:31:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Port 388999f8-b374-406c-9d58-855ff9c23da8 binding to destination host user is already ACTIVE {{(pid=74882) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 21 14:31:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:31:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquired lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:31:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating instance_info_cache with network_info: [{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:09 user nova-compute[74882]: WARNING nova.compute.manager [req-7a7b878e-0579-4c79-af50-77becf630d9f req-aafe4bdb-1cdb-405d-85bd-e78823d8c052 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received unexpected event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with vm_state active and task_state resize_migrated.
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Releasing lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG os_brick.utils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6a23c7-c217-4261-9bea-fbf538c167ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc21a1-b9fb-4083-b85a-ca457ffb6bf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[961bc9a2-d754-4752-b8d3-e90d23a24957]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1027d2b8-6a7f-4e5c-be09-83b089ba5e68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:31:09 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:31:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8519be-78b4-4530-ae64-338f150ad56d]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:31:09 user nova-compute[74882]: DEBUG os_brick.utils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:31:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 is timed out.
Nov 21 14:31:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully detached device vdb from instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 from the live domain config.
Nov 21 14:31:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'migsnZJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:31:10 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6339fe-6b49-4d58-9566-ea9bba0809b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:31:10 user nova-compute[74882]: No targets found.
Nov 21 14:31:10 user nova-compute[74882]: iSNS:
Nov 21 14:31:10 user nova-compute[74882]: No targets found.
Nov 21 14:31:10 user nova-compute[74882]: STATIC:
Nov 21 14:31:10 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:31:10 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:10 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:10 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd
Nov 21 14:31:10 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:10 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:10 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:31:10 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:10 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:10 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1
Nov 21 14:31:10 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:10 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:10 user nova-compute[74882]: FIRMWARE:
Nov 21 14:31:10 user nova-compute[74882]: No targets found.
Nov 21 14:31:10 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:31:10 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:31:10 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2977c1-0671-4e74-bae6-7c4c820704c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b960d0-42c9-423b-9dd2-94048881d5a6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:10 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:10 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:10 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:31:10 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:10 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:10 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:10 user nova-compute[74882]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd (non-flash)
Nov 21 14:31:10 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c1fe9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd'): ({'sdg'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Removing single pathed devices sdg {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcba1e7-e9b7-49c8-80e4-7297b509503c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d258477e-5e74-4669-9410-997c0ad34372]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Flushing IO for device /dev/sdg {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[05776153-49ff-4f2b-8fe7-01006a7877ab]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4cbcc6-ac49-40cf-92a7-3a5ce4d7abda]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] SCSI volumes sdg have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[726632de-61c0-4553-87f7-8cd0b91244ca]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffef59b-6a27-492f-a499-488dacea2131]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260]
Nov 21 14:31:10 user nova-compute[74882]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd, portal: 172.16.0.220,3260] successful.
Nov 21 14:31:10 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6862794e-0a01-4d78-97e8-37855fda7acd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7386acd-07de-4360-9d02-52a87ed826ea]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] <== disconnect_volume: return (291ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:31:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:31:11 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'flavor' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f8e19ee-fd0f-4810-a66e-0e88003db401 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.612s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Starting finish_migration {{(pid=74882) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:31:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Creating image(s)
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Ensure instance console log exists: /opt/stack/data/nova/instances/9a6ece97-45cb-4033-8590-e97182af0a42/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Start _get_guest_xml network_info=[{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394306484-network", "vif_mac": "fa:16:3e:c0:27:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9a6ece97-45cb-4033-8590-e97182af0a42', 'attached_at': '2023-11-21T14:31:15.000000', 'detached_at': '', 'volume_id': '5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'serial': '5b68b64e-527c-465a-96b2-a2fa96e9cb6f'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '02899098-a8a0-4a62-b823-52647a3a690a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:31:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:31:15 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:31:15 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:31:15 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c076fdb-92ff-4d91-a417-b9237160065e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:31:15 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[01098072-a6a8-4c1b-b6ae-fa79e7bbad04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f] added
Nov 21 14:31:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ab874-0eea-41ce-b09d-282143b99f5b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027fe09-e0a7-4e0a-8464-e38aa58b8946]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftkdETvi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ftkdETvi" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db97edb-5df4-4a30-bdb8-c0f97599733a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ftkdETvi'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e54001c-e95e-4987-903e-13a8f7850043]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6691405f-76ec-4820-adc0-4ebae0df917d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed75de28-5f18-46f8-9fa7-4e6341813bcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]
Nov 21 14:31:15 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.
Nov 21 14:31:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b7631-262d-4955-9a6b-69cd4d15bc55]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ba6b1b-4d26-41f2-99c7-14a87e1e26b0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:15 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:15 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.037s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1cc6e9-03df-4c7a-ab14-8085f6733353]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:31:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23963343330316638', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963343330316638', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-765597573',display_name='tempest-ServerActionsTestOtherA-server-765597573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-765597573',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:29:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-4ukk56w4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:31:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=9a6ece97-45cb-4033-8590-e97182af0a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394306484-network", "vif_mac": "fa:16:3e:c0:27:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394306484-network", "vif_mac": "fa:16:3e:c0:27:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:31:16 user nova-compute[74882]:   <uuid>9a6ece97-45cb-4033-8590-e97182af0a42</uuid>
Nov 21 14:31:16 user nova-compute[74882]:   <name>instance-0000001e</name>
Nov 21 14:31:16 user nova-compute[74882]:   <memory>2097152</memory>
Nov 21 14:31:16 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:31:16 user nova-compute[74882]:   <metadata>
Nov 21 14:31:16 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:31:16 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:31:16 user nova-compute[74882]:       <nova:name>tempest-ServerActionsTestOtherA-server-765597573</nova:name>
Nov 21 14:31:16 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:31:15</nova:creationTime>
Nov 21 14:31:16 user nova-compute[74882]:       <nova:flavor name="m1.small">
Nov 21 14:31:16 user nova-compute[74882]:         <nova:memory>2048</nova:memory>
Nov 21 14:31:16 user nova-compute[74882]:         <nova:disk>20</nova:disk>
Nov 21 14:31:16 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:31:16 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:31:16 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:31:16 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:31:16 user nova-compute[74882]:       <nova:owner>
Nov 21 14:31:16 user nova-compute[74882]:         <nova:user uuid="d9f06e22265f45beb3760ea3b9338c25">tempest-ServerActionsTestOtherA-538546207-project-member</nova:user>
Nov 21 14:31:16 user nova-compute[74882]:         <nova:project uuid="079d8162d1ea42ddbf31668c8a44cf73">tempest-ServerActionsTestOtherA-538546207</nova:project>
Nov 21 14:31:16 user nova-compute[74882]:       </nova:owner>
Nov 21 14:31:16 user nova-compute[74882]:       <nova:ports>
Nov 21 14:31:16 user nova-compute[74882]:         <nova:port uuid="388999f8-b374-406c-9d58-855ff9c23da8">
Nov 21 14:31:16 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:31:16 user nova-compute[74882]:         </nova:port>
Nov 21 14:31:16 user nova-compute[74882]:       </nova:ports>
Nov 21 14:31:16 user nova-compute[74882]:     </nova:instance>
Nov 21 14:31:16 user nova-compute[74882]:   </metadata>
Nov 21 14:31:16 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:31:16 user nova-compute[74882]:     <system>
Nov 21 14:31:16 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:31:16 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:31:16 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:31:16 user nova-compute[74882]:       <entry name="serial">9a6ece97-45cb-4033-8590-e97182af0a42</entry>
Nov 21 14:31:16 user nova-compute[74882]:       <entry name="uuid">9a6ece97-45cb-4033-8590-e97182af0a42</entry>
Nov 21 14:31:16 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:31:16 user nova-compute[74882]:     </system>
Nov 21 14:31:16 user nova-compute[74882]:   </sysinfo>
Nov 21 14:31:16 user nova-compute[74882]:   <os>
Nov 21 14:31:16 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:31:16 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:31:16 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:31:16 user nova-compute[74882]:   </os>
Nov 21 14:31:16 user nova-compute[74882]:   <features>
Nov 21 14:31:16 user nova-compute[74882]:     <acpi/>
Nov 21 14:31:16 user nova-compute[74882]:     <apic/>
Nov 21 14:31:16 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:31:16 user nova-compute[74882]:   </features>
Nov 21 14:31:16 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:31:16 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:31:16 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:31:16 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:31:16 user nova-compute[74882]:   </clock>
Nov 21 14:31:16 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:31:16 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:31:16 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:31:16 user nova-compute[74882]:   </cpu>
Nov 21 14:31:16 user nova-compute[74882]:   <devices>
Nov 21 14:31:16 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:31:16 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:31:16 user nova-compute[74882]:       <source dev="/dev/sdd"/>
Nov 21 14:31:16 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:31:16 user nova-compute[74882]:       <serial>5b68b64e-527c-465a-96b2-a2fa96e9cb6f</serial>
Nov 21 14:31:16 user nova-compute[74882]:     </disk>
Nov 21 14:31:16 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:31:16 user nova-compute[74882]:       <mac address="fa:16:3e:c0:27:22"/>
Nov 21 14:31:16 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:31:16 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:31:16 user nova-compute[74882]:       <target dev="tap388999f8-b3"/>
Nov 21 14:31:16 user nova-compute[74882]:     </interface>
Nov 21 14:31:16 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:31:16 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/9a6ece97-45cb-4033-8590-e97182af0a42/console.log" append="off"/>
Nov 21 14:31:16 user nova-compute[74882]:     </serial>
Nov 21 14:31:16 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:31:16 user nova-compute[74882]:     <video>
Nov 21 14:31:16 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:31:16 user nova-compute[74882]:     </video>
Nov 21 14:31:16 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:31:16 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:31:16 user nova-compute[74882]:     </rng>
Nov 21 14:31:16 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:31:16 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:31:16 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:31:16 user nova-compute[74882]:     </memballoon>
Nov 21 14:31:16 user nova-compute[74882]:   </devices>
Nov 21 14:31:16 user nova-compute[74882]: </domain>
Nov 21 14:31:16 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-765597573',display_name='tempest-ServerActionsTestOtherA-server-765597573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-765597573',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:29:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-4ukk56w4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:31:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=9a6ece97-45cb-4033-8590-e97182af0a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394306484-network", "vif_mac": "fa:16:3e:c0:27:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1394306484-network", "vif_mac": "fa:16:3e:c0:27:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG os_vif [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a54263f8-1625-555e-b817-9cc5d0781b9a', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap388999f8-b3, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap388999f8-b3, col_values=(('qos', UUID('3ee409be-5f47-44a2-be39-2d92722214c4')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap388999f8-b3, col_values=(('external_ids', {'iface-id': '388999f8-b374-406c-9d58-855ff9c23da8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:27:22', 'vm-uuid': '9a6ece97-45cb-4033-8590-e97182af0a42'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:16 user nova-compute[74882]: INFO os_vif [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3')
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:31:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] No VIF found with MAC fa:16:3e:c0:27:22, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:31:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:18 user nova-compute[74882]: WARNING nova.compute.manager [req-7f11ad13-cb95-4a4b-9aae-5c8910a925a4 req-f0ea352d-1dcf-45e7-a5ea-2edac040d7bc service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received unexpected event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with vm_state active and task_state resize_finish.
Nov 21 14:31:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:31:20 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance running successfully.
Nov 21 14:31:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Failed to set time: agent not configured {{(pid=74882) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 21 14:31:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d3800ba2-443b-4422-b3a2-ca10bc29234e tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] finish_migration finished successfully. {{(pid=74882) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 21 14:31:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:20 user nova-compute[74882]: WARNING nova.compute.manager [req-f590a189-5c7f-44a2-8f54-2b15c1243cf3 req-e6b23c82-4cd1-45bb-b337-f71f2c10467d service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received unexpected event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with vm_state resized and task_state None.
Nov 21 14:31:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:31:22 user nova-compute[74882]: INFO nova.compute.claims [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Claim successful on node user
Nov 21 14:31:22 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:31:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:31:22 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.policy [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a95c719f033946038ed21c53704577b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42118796db243d7a72988931f9915fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:31:23 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Creating image(s)
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "/opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "/opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "/opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk 1073741824" returned: 0 in 0.047s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Successfully created port: ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Cannot resize image /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Ensure instance console log exists: /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Successfully updated port: ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "refresh_cache-9daf4585-d3ed-425f-bdbb-b4a1e906143b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquired lock "refresh_cache-9daf4585-d3ed-425f-bdbb-b4a1e906143b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received event network-changed-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Refreshing instance network info cache due to event network-changed-ccd597cc-da6f-4360-b5bf-4a1a974decb8. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Acquiring lock "refresh_cache-9daf4585-d3ed-425f-bdbb-b4a1e906143b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Updating instance_info_cache with network_info: [{"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Releasing lock "refresh_cache-9daf4585-d3ed-425f-bdbb-b4a1e906143b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Instance network_info: |[{"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Acquired lock "refresh_cache-9daf4585-d3ed-425f-bdbb-b4a1e906143b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.neutron [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Refreshing network info cache for port ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Start _get_guest_xml network_info=[{"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:31:24 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:24 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-321620301',display_name='tempest-VolumesActionsTest-instance-321620301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-321620301',id=32,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a42118796db243d7a72988931f9915fc',ramdisk_id='',reservation_id='r-s97y7q50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1401937880',owner_user_name='tempest-VolumesActionsTest-1401937880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:31:23Z,user_data=None,user_id='a95c719f033946038ed21c53704577b1',uuid=9daf4585-d3ed-425f-bdbb-b4a1e906143b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converting VIF {"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:a5:d4,bridge_name='br-int',has_traffic_filtering=True,id=ccd597cc-da6f-4360-b5bf-4a1a974decb8,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd597cc-da') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lazy-loading 'pci_devices' on Instance uuid 9daf4585-d3ed-425f-bdbb-b4a1e906143b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:31:24 user nova-compute[74882]:   <uuid>9daf4585-d3ed-425f-bdbb-b4a1e906143b</uuid>
Nov 21 14:31:24 user nova-compute[74882]:   <name>instance-00000020</name>
Nov 21 14:31:24 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:31:24 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:31:24 user nova-compute[74882]:   <metadata>
Nov 21 14:31:24 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:31:24 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:31:24 user nova-compute[74882]:       <nova:name>tempest-VolumesActionsTest-instance-321620301</nova:name>
Nov 21 14:31:24 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:31:24</nova:creationTime>
Nov 21 14:31:24 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:31:24 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:31:24 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:31:24 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:31:24 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:31:24 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:31:24 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:31:24 user nova-compute[74882]:       <nova:owner>
Nov 21 14:31:24 user nova-compute[74882]:         <nova:user uuid="a95c719f033946038ed21c53704577b1">tempest-VolumesActionsTest-1401937880-project-member</nova:user>
Nov 21 14:31:24 user nova-compute[74882]:         <nova:project uuid="a42118796db243d7a72988931f9915fc">tempest-VolumesActionsTest-1401937880</nova:project>
Nov 21 14:31:24 user nova-compute[74882]:       </nova:owner>
Nov 21 14:31:24 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:31:24 user nova-compute[74882]:       <nova:ports>
Nov 21 14:31:24 user nova-compute[74882]:         <nova:port uuid="ccd597cc-da6f-4360-b5bf-4a1a974decb8">
Nov 21 14:31:24 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 21 14:31:24 user nova-compute[74882]:         </nova:port>
Nov 21 14:31:24 user nova-compute[74882]:       </nova:ports>
Nov 21 14:31:24 user nova-compute[74882]:     </nova:instance>
Nov 21 14:31:24 user nova-compute[74882]:   </metadata>
Nov 21 14:31:24 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:31:24 user nova-compute[74882]:     <system>
Nov 21 14:31:24 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:31:24 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:31:24 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:31:24 user nova-compute[74882]:       <entry name="serial">9daf4585-d3ed-425f-bdbb-b4a1e906143b</entry>
Nov 21 14:31:24 user nova-compute[74882]:       <entry name="uuid">9daf4585-d3ed-425f-bdbb-b4a1e906143b</entry>
Nov 21 14:31:24 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:31:24 user nova-compute[74882]:     </system>
Nov 21 14:31:24 user nova-compute[74882]:   </sysinfo>
Nov 21 14:31:24 user nova-compute[74882]:   <os>
Nov 21 14:31:24 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:31:24 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:31:24 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:31:24 user nova-compute[74882]:   </os>
Nov 21 14:31:24 user nova-compute[74882]:   <features>
Nov 21 14:31:24 user nova-compute[74882]:     <acpi/>
Nov 21 14:31:24 user nova-compute[74882]:     <apic/>
Nov 21 14:31:24 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:31:24 user nova-compute[74882]:   </features>
Nov 21 14:31:24 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:31:24 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:31:24 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:31:24 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:31:24 user nova-compute[74882]:   </clock>
Nov 21 14:31:24 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:31:24 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:31:24 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:31:24 user nova-compute[74882]:   </cpu>
Nov 21 14:31:24 user nova-compute[74882]:   <devices>
Nov 21 14:31:24 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:31:24 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:31:24 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk"/>
Nov 21 14:31:24 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:31:24 user nova-compute[74882]:     </disk>
Nov 21 14:31:24 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:31:24 user nova-compute[74882]:       <mac address="fa:16:3e:71:a5:d4"/>
Nov 21 14:31:24 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:31:24 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:31:24 user nova-compute[74882]:       <target dev="tapccd597cc-da"/>
Nov 21 14:31:24 user nova-compute[74882]:     </interface>
Nov 21 14:31:24 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:31:24 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/console.log" append="off"/>
Nov 21 14:31:24 user nova-compute[74882]:     </serial>
Nov 21 14:31:24 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:31:24 user nova-compute[74882]:     <video>
Nov 21 14:31:24 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:31:24 user nova-compute[74882]:     </video>
Nov 21 14:31:24 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:31:24 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:31:24 user nova-compute[74882]:     </rng>
Nov 21 14:31:24 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:31:24 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:31:24 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:31:24 user nova-compute[74882]:     </memballoon>
Nov 21 14:31:24 user nova-compute[74882]:   </devices>
Nov 21 14:31:24 user nova-compute[74882]: </domain>
Nov 21 14:31:24 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-321620301',display_name='tempest-VolumesActionsTest-instance-321620301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-321620301',id=32,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a42118796db243d7a72988931f9915fc',ramdisk_id='',reservation_id='r-s97y7q50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1401937880',owner_user_name='tempest-VolumesActionsTest-1401937880-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:31:23Z,user_data=None,user_id='a95c719f033946038ed21c53704577b1',uuid=9daf4585-d3ed-425f-bdbb-b4a1e906143b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converting VIF {"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:a5:d4,bridge_name='br-int',has_traffic_filtering=True,id=ccd597cc-da6f-4360-b5bf-4a1a974decb8,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd597cc-da') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG os_vif [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a5:d4,bridge_name='br-int',has_traffic_filtering=True,id=ccd597cc-da6f-4360-b5bf-4a1a974decb8,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd597cc-da') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f94837c-1a41-52ea-a622-b0ce217e227d', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccd597cc-da, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccd597cc-da, col_values=(('qos', UUID('bc2056df-04e1-409f-b897-b986f49d174d')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccd597cc-da, col_values=(('external_ids', {'iface-id': 'ccd597cc-da6f-4360-b5bf-4a1a974decb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:a5:d4', 'vm-uuid': '9daf4585-d3ed-425f-bdbb-b4a1e906143b'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:24 user nova-compute[74882]: INFO os_vif [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a5:d4,bridge_name='br-int',has_traffic_filtering=True,id=ccd597cc-da6f-4360-b5bf-4a1a974decb8,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd597cc-da')
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:31:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] No VIF found with MAC fa:16:3e:71:a5:d4, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:31:25 user nova-compute[74882]: DEBUG nova.network.neutron [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Updated VIF entry in instance network info cache for port ccd597cc-da6f-4360-b5bf-4a1a974decb8. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:31:25 user nova-compute[74882]: DEBUG nova.network.neutron [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Updating instance_info_cache with network_info: [{"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4e66008c-dc8c-45bb-987a-d226121568e4 req-45105b23-a8fd-44bf-b918-f105be28b342 service nova] Releasing lock "refresh_cache-9daf4585-d3ed-425f-bdbb-b4a1e906143b" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:26 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 is timed out.
Nov 21 14:31:26 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully detached device vdc from instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 from the live domain config.
Nov 21 14:31:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epuKrOcN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:31:26 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received event network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Acquiring lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] No waiting events found dispatching network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:26 user nova-compute[74882]: WARNING nova.compute.manager [req-d62a2182-a91f-4237-b813-e0bf747d302e req-0be38481-1beb-4659-9970-676610e2299f service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received unexpected event network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance with vm_state building and task_state spawning.
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491d617-8374-489a-9af5-bf82c1d1f5a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:31:26 user nova-compute[74882]: No targets found.
Nov 21 14:31:26 user nova-compute[74882]: iSNS:
Nov 21 14:31:26 user nova-compute[74882]: No targets found.
Nov 21 14:31:26 user nova-compute[74882]: STATIC:
Nov 21 14:31:26 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:31:26 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:26 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:26 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:31:26 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:26 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:26 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f
Nov 21 14:31:26 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:26 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:26 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1
Nov 21 14:31:26 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:26 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:26 user nova-compute[74882]: FIRMWARE:
Nov 21 14:31:26 user nova-compute[74882]: No targets found.
Nov 21 14:31:26 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:31:26 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:31:26 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f167e-460e-44d0-8b2f-e26bd7255661]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[398e9b96-1b09-4e29-9b6c-b12de9fe1092]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:26 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:26 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:26 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:26 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:26 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:26 user nova-compute[74882]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 (non-flash)
Nov 21 14:31:26 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:26 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c732a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb7064f-99ae-467f-85d2-91d7f06f2112]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[585cb33c-2175-485b-8c64-473d5a395de5]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4930623e-6caa-4b42-9cdd-fac416a25d27]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb577d-a63e-4043-bf90-7f31dce72ee7]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d31f570-44fa-4f01-9a9a-17e3546734e9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeca13e-b5b2-4510-a315-a57124cea186]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260]
Nov 21 14:31:26 user nova-compute[74882]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1, portal: 172.16.0.220,3260] successful.
Nov 21 14:31:26 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e790cd0-0035-41f3-bdd9-975c7d9392e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dd1874-d9fa-494a-9f79-975ab52338bf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] <== disconnect_volume: return (388ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'flavor' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received event network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Acquiring lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] No waiting events found dispatching network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:28 user nova-compute[74882]: WARNING nova.compute.manager [req-098a54e8-4bd5-49ab-9099-03310f7b7d40 req-240b9245-cc3c-46f1-9340-ed0ad4421c44 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received unexpected event network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance with vm_state building and task_state spawning.
Nov 21 14:31:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db8ddefd-3fa7-4a7e-8248-d357e917f9d4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.694s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:31:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Instance spawned successfully.
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:31:28 user nova-compute[74882]: INFO nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 21 14:31:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:31:29 user nova-compute[74882]: INFO nova.compute.manager [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Took 6.75 seconds to build instance.
Nov 21 14:31:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbf9bee1-abfd-45ea-805b-f1a025995c6c tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.876s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:29 user nova-compute[74882]: INFO nova.compute.manager [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Terminating instance
Nov 21 14:31:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-vif-unplugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] No waiting events found dispatching network-vif-unplugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-b3796131-3ff9-4738-8ad4-18a7a2d78a32 req-691827ba-56c0-4146-99cb-e4eed46baa06 service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-vif-unplugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Instance destroyed successfully.
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.objects.instance [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lazy-loading 'resources' on Instance uuid bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666390476',display_name='tempest-AttachVolumeTestJSON-server-666390476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666390476',id=25,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdfjBdUaeg5gBMzRCIC2CLsKPZxcHOKYD5qYtqN1/wF9/M2H5BGBIvefGyVawGV2+mQ5eBpSZ0rozkc8ojAdQgF74dQtDNJ6Q333DFnreFkyQAnkBfUkLkWnCnqPtz+Tg==',key_name='tempest-keypair-1711900749',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:28:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='894802e2e3d044199467be931dd8e036',ramdisk_id='',reservation_id='r-ihkrbyin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1610644153',owner_user_name='tempest-AttachVolumeTestJSON-1610644153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0cb90d4bdf74f9390124833ea8331bd',uuid=bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converting VIF {"id": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "address": "fa:16:3e:ae:e1:17", "network": {"id": "04f88176-57de-4a45-96e0-55319f3d0f1f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1277640920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "894802e2e3d044199467be931dd8e036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb08c806e-bd", "ovs_interfaceid": "b08c806e-bd8a-4ff2-9e57-7e282ee74121", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b08c806e-bd8a-4ff2-9e57-7e282ee74121,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08c806e-bd') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG os_vif [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b08c806e-bd8a-4ff2-9e57-7e282ee74121,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08c806e-bd') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb08c806e-bd, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e8e8b13-9d88-49be-815c-f880ae7e076e) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:30 user nova-compute[74882]: INFO os_vif [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:e1:17,bridge_name='br-int',has_traffic_filtering=True,id=b08c806e-bd8a-4ff2-9e57-7e282ee74121,network=Network(04f88176-57de-4a45-96e0-55319f3d0f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb08c806e-bd')
Nov 21 14:31:30 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Deleting instance files /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1_del
Nov 21 14:31:30 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Deletion of /opt/stack/data/nova/instances/bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1_del complete
Nov 21 14:31:30 user nova-compute[74882]: INFO nova.compute.manager [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 21 14:31:30 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:31:30 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:31:31 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:31 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Took 0.83 seconds to deallocate network for instance.
Nov 21 14:31:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:32 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Deleted allocations for instance bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1
Nov 21 14:31:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-133064a5-21b5-46f9-91fa-ce681e2c85e4 tempest-AttachVolumeTestJSON-1610644153 tempest-AttachVolumeTestJSON-1610644153-project-member] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Acquiring lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] Lock "bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] No waiting events found dispatching network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:32 user nova-compute[74882]: WARNING nova.compute.manager [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received unexpected event network-vif-plugged-b08c806e-bd8a-4ff2-9e57-7e282ee74121 for instance with vm_state deleted and task_state None.
Nov 21 14:31:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-3469c1c2-9a7f-451a-b544-526b4f95f40d req-5613d5a3-674c-4f75-9fa9-1e2f6fc7c2ea service nova] [instance: bbb966ec-8f33-43ba-86f5-8dbae2cdc1a1] Received event network-vif-deleted-b08c806e-bd8a-4ff2-9e57-7e282ee74121 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:34 user nova-compute[74882]: INFO nova.compute.manager [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Terminating instance
Nov 21 14:31:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-a2eea0ec-0c75-4c52-a0dc-5efb027dda59 req-d04ecd2c-38f7-4a8d-b4da-2049e1ed8c8a service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-unplugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Instance destroyed successfully.
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lazy-loading 'resources' on Instance uuid 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1299552937',display_name='tempest-ServerActionsTestOtherB-server-1299552937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1299552937',id=18,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh/5TUnFysib6Qwjajjal6PhqAS64jmTMrACO1fqgOy20bjVpGsl70z0bWGGgM8dodxRUQIxLYaPYXspRNI0oiy5XJtlwncOdxmKP0n1yfyxz0Q/+5wGJ4Nc41g/KVi6w==',key_name='tempest-keypair-1155942104',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:29:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccf822369a824ed3912173b2f27fddbf',ramdisk_id='',reservation_id='r-22kth9pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2073286927',owner_user_name='tempest-ServerActionsTestOtherB-2073286927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a19fbffc4df04656950aa2bb1a2bb48a',uuid=101c9eaa-a8f5-4840-a1d7-454b0be5d5d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converting VIF {"id": "23e1e132-07a0-4650-9032-872a2dfeafb4", "address": "fa:16:3e:c6:d9:99", "network": {"id": "c79fd2b1-e52c-4763-9cca-3335eec59112", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-309229548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccf822369a824ed3912173b2f27fddbf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23e1e132-07", "ovs_interfaceid": "23e1e132-07a0-4650-9032-872a2dfeafb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_vif [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23e1e132-07, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb0deffc-71c7-40e0-b275-a76234e66a0d) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:35 user nova-compute[74882]: INFO os_vif [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=23e1e132-07a0-4650-9032-872a2dfeafb4,network=Network(c79fd2b1-e52c-4763-9cca-3335eec59112),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23e1e132-07')
Nov 21 14:31:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjqTdmgH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:31:35 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d571c4-db53-492c-bf8c-deb8e66a0cb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:31:35 user nova-compute[74882]: No targets found.
Nov 21 14:31:35 user nova-compute[74882]: iSNS:
Nov 21 14:31:35 user nova-compute[74882]: No targets found.
Nov 21 14:31:35 user nova-compute[74882]: STATIC:
Nov 21 14:31:35 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:31:35 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:35 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:35 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35
Nov 21 14:31:35 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:35 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:35 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f
Nov 21 14:31:35 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:31:35 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:31:35 user nova-compute[74882]: FIRMWARE:
Nov 21 14:31:35 user nova-compute[74882]: No targets found.
Nov 21 14:31:35 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:31:35 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:31:35 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb4cad6-17e0-4a44-86d7-0c756094c929]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a24cebb-a5ab-49e7-91a1-a719997a2cce]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:35 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:35 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:35 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:31:35 user nova-compute[74882]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 (non-flash)
Nov 21 14:31:35 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:31:35 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c6bab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93684be-ec80-4d9a-9edb-2416af1cc22b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569008b-5b06-48be-b65f-74ca867103bd]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1ff396-0df3-4fed-abb9-fcd654fba868]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:31:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ee9017-9c6c-4c23-ae8d-30eb25408c24]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e72309e-ac10-4f63-be18-c9821b876735]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1050feae-84c7-47a7-bb3b-7d03aef84613]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260]
Nov 21 14:31:36 user nova-compute[74882]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35, portal: 172.16.0.220,3260] successful.
Nov 21 14:31:36 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80204876-2834-4680-8b28-90fd14c4ae35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cebd78-78d2-4039-8c88-72066936621d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] <== disconnect_volume: return (356ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:31:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Deleting instance files /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0_del
Nov 21 14:31:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Deletion of /opt/stack/data/nova/instances/101c9eaa-a8f5-4840-a1d7-454b0be5d5d0_del complete
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: INFO nova.compute.manager [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:36 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-deleted-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:37 user nova-compute[74882]: INFO nova.compute.manager [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Neutron deleted interface 23e1e132-07a0-4650-9032-872a2dfeafb4; detaching it from the instance and deleting it from the info cache
Nov 21 14:31:37 user nova-compute[74882]: DEBUG nova.network.neutron [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:37 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Took 0.72 seconds to deallocate network for instance.
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-c11b3c76-098e-4420-8baf-b45b0ead411e req-3202986b-2d6d-47e8-8ebf-287eb8016eb1 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Detach interface failed, port_id=23e1e132-07a0-4650-9032-872a2dfeafb4, reason: Instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0 could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '101c9eaa-a8f5-4840-a1d7-454b0be5d5d0' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '101c9eaa-a8f5-4840-a1d7-454b0be5d5d0' (instance-00000012)
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Acquiring lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] No waiting events found dispatching network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:31:37 user nova-compute[74882]: WARNING nova.compute.manager [req-4cee7031-40d1-405a-ba18-83accfbdafc7 req-d42cf508-5846-4ae5-9159-ac16b10f25f0 service nova] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Received unexpected event network-vif-plugged-23e1e132-07a0-4650-9032-872a2dfeafb4 for instance with vm_state active and task_state deleting.
Nov 21 14:31:37 user nova-compute[74882]: INFO nova.compute.manager [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] [instance: 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0] Took 0.91 seconds to detach 1 volumes for instance.
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:38 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:38 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:31:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.25705337524414GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:31:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:31:38 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:31:38 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:31:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.880s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.405s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:31:38 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Deleted allocations for instance 101c9eaa-a8f5-4840-a1d7-454b0be5d5d0
Nov 21 14:31:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Applying migration context for instance 9a6ece97-45cb-4033-8590-e97182af0a42 as it has an incoming, in-progress migration 2a15fc7f-014b-4415-88a4-b168846e6686. Migration status is finished {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 21 14:31:38 user nova-compute[74882]: INFO nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating resource usage from migration 2a15fc7f-014b-4415-88a4-b168846e6686
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Migration 2a15fc7f-014b-4415-88a4-b168846e6686 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2fc73541-652c-4182-b780-9feb2c644e52 tempest-ServerActionsTestOtherB-2073286927 tempest-ServerActionsTestOtherB-2073286927-project-member] Lock "101c9eaa-a8f5-4840-a1d7-454b0be5d5d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.097s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:31:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:31:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:31:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid cdeb200f-cb4f-4916-8fef-b35ff231d033 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:31:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [{"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:31:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-cdeb200f-cb4f-4916-8fef-b35ff231d033" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:31:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:31:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:31:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:04 user nova-compute[74882]: INFO nova.compute.manager [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Terminating instance
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-vif-unplugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] No waiting events found dispatching network-vif-unplugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-bf21bdff-4c99-459f-abf1-0e4e61a632c9 req-fb7c7e2d-fbca-46d1-abc5-a0f6b00f6660 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-vif-unplugged-2ab935fb-7141-46fd-92c0-9c10ef997044 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:32:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Instance destroyed successfully.
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lazy-loading 'resources' on Instance uuid bca6a77c-bc37-4822-b9ed-2c7e16acf0b9 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2128921177',display_name='tempest-SnapshotDataIntegrityTests-server-2128921177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2128921177',id=23,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG3C2rVjflbNsS9fKtX50ZVRu5n7hGzzD2zwaWwS3KzXKPvBtd1mXi21f4ioMDYvXo98cbLQmUZWrfcw0qGCu34xhX57TDr4UvaDP0layliW8yevW9tj503nkyjdRiFJg==',key_name='tempest-keypair-1440997765',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:25:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='391e0d9d2d344d06a315a6bbea613404',ramdisk_id='',reservation_id='r-f243hrxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1410147940',owner_user_name='tempest-SnapshotDataIntegrityTests-1410147940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:25:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45ba98964518472c872e959c17ca4f1e',uuid=bca6a77c-bc37-4822-b9ed-2c7e16acf0b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Converting VIF {"id": "2ab935fb-7141-46fd-92c0-9c10ef997044", "address": "fa:16:3e:c5:66:55", "network": {"id": "36a03207-b935-4278-88e1-4bded651091e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1385080541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "391e0d9d2d344d06a315a6bbea613404", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab935fb-71", "ovs_interfaceid": "2ab935fb-7141-46fd-92c0-9c10ef997044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:66:55,bridge_name='br-int',has_traffic_filtering=True,id=2ab935fb-7141-46fd-92c0-9c10ef997044,network=Network(36a03207-b935-4278-88e1-4bded651091e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab935fb-71') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG os_vif [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:66:55,bridge_name='br-int',has_traffic_filtering=True,id=2ab935fb-7141-46fd-92c0-9c10ef997044,network=Network(36a03207-b935-4278-88e1-4bded651091e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab935fb-71') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ab935fb-71, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cfb880b-6dc9-49f4-a3fb-2d67ce1b52d3) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:04 user nova-compute[74882]: INFO os_vif [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:66:55,bridge_name='br-int',has_traffic_filtering=True,id=2ab935fb-7141-46fd-92c0-9c10ef997044,network=Network(36a03207-b935-4278-88e1-4bded651091e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab935fb-71')
Nov 21 14:32:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Deleting instance files /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9_del
Nov 21 14:32:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Deletion of /opt/stack/data/nova/instances/bca6a77c-bc37-4822-b9ed-2c7e16acf0b9_del complete
Nov 21 14:32:05 user nova-compute[74882]: INFO nova.compute.manager [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 21 14:32:05 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:32:05 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:32:05 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:32:05 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:32:05 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Took 0.87 seconds to deallocate network for instance.
Nov 21 14:32:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-cda3b505-f7bb-44c9-935e-4568b03f87bd req-49b1d52f-d403-4c85-b532-2400c956437c service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-vif-deleted-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:32:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:06 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:32:06 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:32:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:06 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Deleted allocations for instance bca6a77c-bc37-4822-b9ed-2c7e16acf0b9
Nov 21 14:32:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received event network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:32:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Acquiring lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] No waiting events found dispatching network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:32:06 user nova-compute[74882]: WARNING nova.compute.manager [req-3a29f344-1fe8-462e-b4ce-0838f2fe011d req-6229f1b6-8279-456a-81df-91d62d627c32 service nova] [instance: bca6a77c-bc37-4822-b9ed-2c7e16acf0b9] Received unexpected event network-vif-plugged-2ab935fb-7141-46fd-92c0-9c10ef997044 for instance with vm_state deleted and task_state None.
Nov 21 14:32:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9b4d2a02-1689-4089-a980-230046d34247 tempest-SnapshotDataIntegrityTests-1410147940 tempest-SnapshotDataIntegrityTests-1410147940-project-member] Lock "bca6a77c-bc37-4822-b9ed-2c7e16acf0b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5010 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:32:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:32:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:32:36 user nova-compute[74882]: INFO nova.compute.manager [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] instance snapshotting
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Beginning live snapshot process
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp48zm60jv/b5a534088bb8443e97d1792583e4c3f6.delta 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp48zm60jv/b5a534088bb8443e97d1792583e4c3f6.delta 1073741824" returned: 0 in 0.084s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:32:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:32:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7803MB free_disk=25.272613525390625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:32:39 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Applying migration context for instance 9a6ece97-45cb-4033-8590-e97182af0a42 as it has an incoming, in-progress migration 2a15fc7f-014b-4415-88a4-b168846e6686. Migration status is finished {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 21 14:32:39 user nova-compute[74882]: INFO nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating resource usage from migration 2a15fc7f-014b-4415-88a4-b168846e6686
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp48zm60jv/b5a534088bb8443e97d1792583e4c3f6.delta /opt/stack/data/nova/instances/snapshots/tmp48zm60jv/b5a534088bb8443e97d1792583e4c3f6 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Migration 2a15fc7f-014b-4415-88a4-b168846e6686 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:32:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:32:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:40 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:32:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp48zm60jv/b5a534088bb8443e97d1792583e4c3f6.delta /opt/stack/data/nova/instances/snapshots/tmp48zm60jv/b5a534088bb8443e97d1792583e4c3f6" returned: 0 in 0.410s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:32:40 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Snapshot extracted, beginning image upload
Nov 21 14:32:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:32:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:32:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Snapshot image upload complete
Nov 21 14:32:43 user nova-compute[74882]: INFO nova.compute.manager [None req-6ea281ea-db37-47b8-a8bb-6a230538a00f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Took 6.73 seconds to snapshot the instance on the hypervisor.
Nov 21 14:32:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:32:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:32:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:32:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:32:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:32:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updating instance_info_cache with network_info: [{"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:32:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:32:44 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:32:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:32:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Going to confirm migration 2 {{(pid=74882) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquired lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG nova.network.neutron [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:32:55 user nova-compute[74882]: DEBUG nova.objects.instance [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'info_cache' on Instance uuid 9a6ece97-45cb-4033-8590-e97182af0a42 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG nova.network.neutron [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating instance_info_cache with network_info: [{"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Releasing lock "refresh_cache-9a6ece97-45cb-4033-8590-e97182af0a42" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG nova.objects.instance [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'migration_context' on Instance uuid 9a6ece97-45cb-4033-8590-e97182af0a42 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG nova.objects.base [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Object Instance<9a6ece97-45cb-4033-8590-e97182af0a42> lazy-loaded attributes: info_cache,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:32:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.404s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:56 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Deleted allocation for migration 2a15fc7f-014b-4415-88a4-b168846e6686
Nov 21 14:32:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-120b3a58-857e-478e-974c-b4486fbacad4 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.801s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:32:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:33:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:12 user nova-compute[74882]: INFO nova.compute.manager [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Terminating instance
Nov 21 14:33:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:33:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received event network-vif-unplugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Acquiring lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] No waiting events found dispatching network-vif-unplugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-15633257-3283-41d6-9863-d55f7729f0cb req-60a5b89a-541e-4712-a1cd-bb1f772a26bf service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received event network-vif-unplugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:33:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Instance destroyed successfully.
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.objects.instance [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lazy-loading 'resources' on Instance uuid 9daf4585-d3ed-425f-bdbb-b4a1e906143b {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-321620301',display_name='tempest-VolumesActionsTest-instance-321620301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-321620301',id=32,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:31:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a42118796db243d7a72988931f9915fc',ramdisk_id='',reservation_id='r-s97y7q50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1401937880',owner_user_name='tempest-VolumesActionsTest-1401937880-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:31:29Z,user_data=None,user_id='a95c719f033946038ed21c53704577b1',uuid=9daf4585-d3ed-425f-bdbb-b4a1e906143b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converting VIF {"id": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "address": "fa:16:3e:71:a5:d4", "network": {"id": "1c3454df-506b-4b57-a1b8-7d5145019fba", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1178141642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a42118796db243d7a72988931f9915fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd597cc-da", "ovs_interfaceid": "ccd597cc-da6f-4360-b5bf-4a1a974decb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:a5:d4,bridge_name='br-int',has_traffic_filtering=True,id=ccd597cc-da6f-4360-b5bf-4a1a974decb8,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd597cc-da') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG os_vif [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a5:d4,bridge_name='br-int',has_traffic_filtering=True,id=ccd597cc-da6f-4360-b5bf-4a1a974decb8,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd597cc-da') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccd597cc-da, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc2056df-04e1-409f-b897-b986f49d174d) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:33:13 user nova-compute[74882]: INFO os_vif [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:a5:d4,bridge_name='br-int',has_traffic_filtering=True,id=ccd597cc-da6f-4360-b5bf-4a1a974decb8,network=Network(1c3454df-506b-4b57-a1b8-7d5145019fba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd597cc-da')
Nov 21 14:33:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Deleting instance files /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b_del
Nov 21 14:33:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Deletion of /opt/stack/data/nova/instances/9daf4585-d3ed-425f-bdbb-b4a1e906143b_del complete
Nov 21 14:33:13 user nova-compute[74882]: INFO nova.compute.manager [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 21 14:33:13 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:33:13 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:33:14 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:33:14 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Took 0.42 seconds to deallocate network for instance.
Nov 21 14:33:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-9ef7469b-3a40-40b2-b236-c097ea29ef17 req-c8cf3da3-045e-4aa5-b616-ee25e22b2158 service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received event network-vif-deleted-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:14 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:33:14 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:33:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:14 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Deleted allocations for instance 9daf4585-d3ed-425f-bdbb-b4a1e906143b
Nov 21 14:33:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d589a0d6-e4b9-43bb-bc65-7f378a0bb692 tempest-VolumesActionsTest-1401937880 tempest-VolumesActionsTest-1401937880-project-member] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received event network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Acquiring lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] Lock "9daf4585-d3ed-425f-bdbb-b4a1e906143b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] No waiting events found dispatching network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:15 user nova-compute[74882]: WARNING nova.compute.manager [req-dedb1fba-fd0a-4c92-9996-08960eb223de req-79e456c0-ba17-48a4-b85b-d4df84094f0a service nova] [instance: 9daf4585-d3ed-425f-bdbb-b4a1e906143b] Received unexpected event network-vif-plugged-ccd597cc-da6f-4360-b5bf-4a1a974decb8 for instance with vm_state deleted and task_state None.
Nov 21 14:33:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:33:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:33:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:33:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:33:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:33:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:33:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8213MB free_disk=25.235660552978516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:33:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:44 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:44 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:33:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:33:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:33:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating instance_info_cache with network_info: [{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:33:46 user nova-compute[74882]: INFO nova.compute.claims [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Claim successful on node user
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:33:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:33:46 user nova-compute[74882]: DEBUG nova.policy [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7635b3029cf14950a1978282d06bc8f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96e5113ec65d46c4b8859c4658433b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:33:46 user nova-compute[74882]: INFO nova.virt.block_device [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Booting with volume-backed-image 56f0cfc7-adc4-437a-accc-8a2f8cd4e785 at /dev/vda
Nov 21 14:33:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Successfully created port: d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Successfully updated port: d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-changed-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Refreshing instance network info cache due to event network-changed-d01918fa-7533-4b43-95ca-1baa184edfdc. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:33:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Acquiring lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Updating instance_info_cache with network_info: [{"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance network_info: |[{"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Acquired lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG nova.network.neutron [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Refreshing network info cache for port d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG nova.network.neutron [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Updated VIF entry in instance network info cache for port d01918fa-7533-4b43-95ca-1baa184edfdc. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG nova.network.neutron [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Updating instance_info_cache with network_info: [{"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:33:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8480c8b8-40ab-469d-b891-1d719fab866a req-0dd2b47d-5aec-4c8e-9487-66d5bf21d286 service nova] Releasing lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:33:49 user nova-compute[74882]: INFO nova.compute.claims [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Claim successful on node user
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:33:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.policy [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:33:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Creating image(s)
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "/opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "/opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "/opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk 1073741824" returned: 0 in 0.057s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG nova.network.neutron [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Successfully created port: b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.217s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Cannot resize image /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Ensure instance console log exists: /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Successfully updated port: b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquired lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-changed-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Refreshing instance network info cache due to event network-changed-b71689fa-96c5-44a3-9305-2d3504cfc9a3. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Acquiring lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Updating instance_info_cache with network_info: [{"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Releasing lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Instance network_info: |[{"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Acquired lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Refreshing network info cache for port b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Start _get_guest_xml network_info=[{"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:33:51 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:51 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:33:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1495642543',display_name='tempest-VolumesSnapshotTestJSON-instance-1495642543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1495642543',id=34,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOorQNTa6zgu29HxzWmEkoqhVpSdQf4ZfG77uGHFVBNgLTXqaCSl0pFAJ0Bq3aaAHnqpF80Pd7HIBQXQ67rIYl2dTa7CpM5rgqHaoAFffHONec18YKMUOY1lD0YzpFlI7Q==',key_name='tempest-keypair-832007284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea6fab008a747ef9093b7c92fb27708',ramdisk_id='',reservation_id='r-6lou2ocn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985664337',owner_user_name='tempest-VolumesSnapshotTestJSON-1985664337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ad8112276648628ce9669c2445ea81',uuid=20630cb7-62c9-4e13-86a7-2432ed79368a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converting VIF {"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:64:35,bridge_name='br-int',has_traffic_filtering=True,id=b71689fa-96c5-44a3-9305-2d3504cfc9a3,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71689fa-96') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.objects.instance [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'pci_devices' on Instance uuid 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:33:51 user nova-compute[74882]:   <uuid>20630cb7-62c9-4e13-86a7-2432ed79368a</uuid>
Nov 21 14:33:51 user nova-compute[74882]:   <name>instance-00000022</name>
Nov 21 14:33:51 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:33:51 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:33:51 user nova-compute[74882]:   <metadata>
Nov 21 14:33:51 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:33:51 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:33:51 user nova-compute[74882]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1495642543</nova:name>
Nov 21 14:33:51 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:33:51</nova:creationTime>
Nov 21 14:33:51 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:33:51 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:33:51 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:33:51 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:33:51 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:33:51 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:33:51 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:33:51 user nova-compute[74882]:       <nova:owner>
Nov 21 14:33:51 user nova-compute[74882]:         <nova:user uuid="d7ad8112276648628ce9669c2445ea81">tempest-VolumesSnapshotTestJSON-1985664337-project-member</nova:user>
Nov 21 14:33:51 user nova-compute[74882]:         <nova:project uuid="eea6fab008a747ef9093b7c92fb27708">tempest-VolumesSnapshotTestJSON-1985664337</nova:project>
Nov 21 14:33:51 user nova-compute[74882]:       </nova:owner>
Nov 21 14:33:51 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:33:51 user nova-compute[74882]:       <nova:ports>
Nov 21 14:33:51 user nova-compute[74882]:         <nova:port uuid="b71689fa-96c5-44a3-9305-2d3504cfc9a3">
Nov 21 14:33:51 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 14:33:51 user nova-compute[74882]:         </nova:port>
Nov 21 14:33:51 user nova-compute[74882]:       </nova:ports>
Nov 21 14:33:51 user nova-compute[74882]:     </nova:instance>
Nov 21 14:33:51 user nova-compute[74882]:   </metadata>
Nov 21 14:33:51 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:33:51 user nova-compute[74882]:     <system>
Nov 21 14:33:51 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:33:51 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:33:51 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:33:51 user nova-compute[74882]:       <entry name="serial">20630cb7-62c9-4e13-86a7-2432ed79368a</entry>
Nov 21 14:33:51 user nova-compute[74882]:       <entry name="uuid">20630cb7-62c9-4e13-86a7-2432ed79368a</entry>
Nov 21 14:33:51 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:33:51 user nova-compute[74882]:     </system>
Nov 21 14:33:51 user nova-compute[74882]:   </sysinfo>
Nov 21 14:33:51 user nova-compute[74882]:   <os>
Nov 21 14:33:51 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:33:51 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:33:51 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:33:51 user nova-compute[74882]:   </os>
Nov 21 14:33:51 user nova-compute[74882]:   <features>
Nov 21 14:33:51 user nova-compute[74882]:     <acpi/>
Nov 21 14:33:51 user nova-compute[74882]:     <apic/>
Nov 21 14:33:51 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:33:51 user nova-compute[74882]:   </features>
Nov 21 14:33:51 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:33:51 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:33:51 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:33:51 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:33:51 user nova-compute[74882]:   </clock>
Nov 21 14:33:51 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:33:51 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:33:51 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:33:51 user nova-compute[74882]:   </cpu>
Nov 21 14:33:51 user nova-compute[74882]:   <devices>
Nov 21 14:33:51 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:33:51 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:33:51 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk"/>
Nov 21 14:33:51 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:33:51 user nova-compute[74882]:     </disk>
Nov 21 14:33:51 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:33:51 user nova-compute[74882]:       <mac address="fa:16:3e:96:64:35"/>
Nov 21 14:33:51 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:33:51 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:33:51 user nova-compute[74882]:       <target dev="tapb71689fa-96"/>
Nov 21 14:33:51 user nova-compute[74882]:     </interface>
Nov 21 14:33:51 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:33:51 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/console.log" append="off"/>
Nov 21 14:33:51 user nova-compute[74882]:     </serial>
Nov 21 14:33:51 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:33:51 user nova-compute[74882]:     <video>
Nov 21 14:33:51 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:33:51 user nova-compute[74882]:     </video>
Nov 21 14:33:51 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:33:51 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:33:51 user nova-compute[74882]:     </rng>
Nov 21 14:33:51 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:33:51 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:33:51 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:33:51 user nova-compute[74882]:     </memballoon>
Nov 21 14:33:51 user nova-compute[74882]:   </devices>
Nov 21 14:33:51 user nova-compute[74882]: </domain>
Nov 21 14:33:51 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:33:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1495642543',display_name='tempest-VolumesSnapshotTestJSON-instance-1495642543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1495642543',id=34,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOorQNTa6zgu29HxzWmEkoqhVpSdQf4ZfG77uGHFVBNgLTXqaCSl0pFAJ0Bq3aaAHnqpF80Pd7HIBQXQ67rIYl2dTa7CpM5rgqHaoAFffHONec18YKMUOY1lD0YzpFlI7Q==',key_name='tempest-keypair-832007284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea6fab008a747ef9093b7c92fb27708',ramdisk_id='',reservation_id='r-6lou2ocn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985664337',owner_user_name='tempest-VolumesSnapshotTestJSON-1985664337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ad8112276648628ce9669c2445ea81',uuid=20630cb7-62c9-4e13-86a7-2432ed79368a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converting VIF {"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:64:35,bridge_name='br-int',has_traffic_filtering=True,id=b71689fa-96c5-44a3-9305-2d3504cfc9a3,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71689fa-96') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG os_vif [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:64:35,bridge_name='br-int',has_traffic_filtering=True,id=b71689fa-96c5-44a3-9305-2d3504cfc9a3,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71689fa-96') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d767b3f-df57-5957-8f89-3cea0e60f41f', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb71689fa-96, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb71689fa-96, col_values=(('qos', UUID('04b0ddd1-cfb8-4f2d-b696-aca2d6d8aefe')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb71689fa-96, col_values=(('external_ids', {'iface-id': 'b71689fa-96c5-44a3-9305-2d3504cfc9a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:64:35', 'vm-uuid': '20630cb7-62c9-4e13-86a7-2432ed79368a'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:51 user nova-compute[74882]: INFO os_vif [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:64:35,bridge_name='br-int',has_traffic_filtering=True,id=b71689fa-96c5-44a3-9305-2d3504cfc9a3,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71689fa-96')
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No VIF found with MAC fa:16:3e:96:64:35, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Updated VIF entry in instance network info cache for port b71689fa-96c5-44a3-9305-2d3504cfc9a3. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Updating instance_info_cache with network_info: [{"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:33:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-828927ee-a812-437b-abce-5a6c67f9404e req-15df6a0e-85f2-445e-8dff-a1a3e4504011 service nova] Releasing lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG os_brick.utils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b72f7b-4964-49ae-a282-757f024e7763]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[09744834-983f-4b35-a375-6bf7f4de7fc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[faacd5c3-13e1-454c-ab28-df48c059ce29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c984376-3e49-4c08-b18e-239696e4898b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:33:52 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d26ffc-d8a7-47de-91f9-7f0f912f5f70]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG os_brick.utils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Updating existing volume attachment record: 625059ac-e64b-4897-8ab6-af12ec6100a2 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:33:52 user nova-compute[74882]: INFO nova.compute.manager [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Rescuing
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:33:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] No waiting events found dispatching network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:53 user nova-compute[74882]: WARNING nova.compute.manager [req-906469f6-230f-4611-b4ae-c4e8de11ee62 req-ed4886aa-78df-445f-875f-3d8dec89a5c0 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received unexpected event network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance with vm_state building and task_state spawning.
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance destroyed successfully.
Nov 21 14:33:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Attempting rescue
Nov 21 14:33:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74882) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:33:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Creating image(s)
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue" returned: 0 in 0.063s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'migration_context' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.base [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<8f8ecb76-9606-4119-a5e6-53fe33413b0c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Start _get_guest_xml network_info=[{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:6b:07:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'resources' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.base [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<8f8ecb76-9606-4119-a5e6-53fe33413b0c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'numa_topology' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.base [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<8f8ecb76-9606-4119-a5e6-53fe33413b0c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:33:54 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:54 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.base [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<8f8ecb76-9606-4119-a5e6-53fe33413b0c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175800306',display_name='tempest-ServerRescueNegativeTestJSON-server-175800306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175800306',id=28,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-6t5y3swy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:29:17Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=8f8ecb76-9606-4119-a5e6-53fe33413b0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:6b:07:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:6b:07:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.objects.base [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<8f8ecb76-9606-4119-a5e6-53fe33413b0c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:33:54 user nova-compute[74882]:   <uuid>8f8ecb76-9606-4119-a5e6-53fe33413b0c</uuid>
Nov 21 14:33:54 user nova-compute[74882]:   <name>instance-0000001c</name>
Nov 21 14:33:54 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:33:54 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:33:54 user nova-compute[74882]:   <metadata>
Nov 21 14:33:54 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:33:54 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:33:54 user nova-compute[74882]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-175800306</nova:name>
Nov 21 14:33:54 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:33:54</nova:creationTime>
Nov 21 14:33:54 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:33:54 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:33:54 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:33:54 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:33:54 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:33:54 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:33:54 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:33:54 user nova-compute[74882]:       <nova:owner>
Nov 21 14:33:54 user nova-compute[74882]:         <nova:user uuid="4b8ebb88fee544a793fd71ebeee0845f">tempest-ServerRescueNegativeTestJSON-2007417611-project-member</nova:user>
Nov 21 14:33:54 user nova-compute[74882]:         <nova:project uuid="e50c445b6ade47c09380da2248cf5954">tempest-ServerRescueNegativeTestJSON-2007417611</nova:project>
Nov 21 14:33:54 user nova-compute[74882]:       </nova:owner>
Nov 21 14:33:54 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:33:54 user nova-compute[74882]:       <nova:ports>
Nov 21 14:33:54 user nova-compute[74882]:         <nova:port uuid="1e015b80-8ab0-446f-aebd-541aaae71b0f">
Nov 21 14:33:54 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 21 14:33:54 user nova-compute[74882]:         </nova:port>
Nov 21 14:33:54 user nova-compute[74882]:       </nova:ports>
Nov 21 14:33:54 user nova-compute[74882]:     </nova:instance>
Nov 21 14:33:54 user nova-compute[74882]:   </metadata>
Nov 21 14:33:54 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:33:54 user nova-compute[74882]:     <system>
Nov 21 14:33:54 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:33:54 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:33:54 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:33:54 user nova-compute[74882]:       <entry name="serial">8f8ecb76-9606-4119-a5e6-53fe33413b0c</entry>
Nov 21 14:33:54 user nova-compute[74882]:       <entry name="uuid">8f8ecb76-9606-4119-a5e6-53fe33413b0c</entry>
Nov 21 14:33:54 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:33:54 user nova-compute[74882]:     </system>
Nov 21 14:33:54 user nova-compute[74882]:   </sysinfo>
Nov 21 14:33:54 user nova-compute[74882]:   <os>
Nov 21 14:33:54 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:33:54 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:33:54 user nova-compute[74882]:   </os>
Nov 21 14:33:54 user nova-compute[74882]:   <features>
Nov 21 14:33:54 user nova-compute[74882]:     <acpi/>
Nov 21 14:33:54 user nova-compute[74882]:     <apic/>
Nov 21 14:33:54 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:33:54 user nova-compute[74882]:   </features>
Nov 21 14:33:54 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:33:54 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:33:54 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:33:54 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:33:54 user nova-compute[74882]:   </clock>
Nov 21 14:33:54 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:33:54 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:33:54 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:33:54 user nova-compute[74882]:   </cpu>
Nov 21 14:33:54 user nova-compute[74882]:   <devices>
Nov 21 14:33:54 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:33:54 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:33:54 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue"/>
Nov 21 14:33:54 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:33:54 user nova-compute[74882]:     </disk>
Nov 21 14:33:54 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:33:54 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:33:54 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk"/>
Nov 21 14:33:54 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:33:54 user nova-compute[74882]:     </disk>
Nov 21 14:33:54 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:33:54 user nova-compute[74882]:       <mac address="fa:16:3e:6b:07:97"/>
Nov 21 14:33:54 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:33:54 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:33:54 user nova-compute[74882]:       <target dev="tap1e015b80-8a"/>
Nov 21 14:33:54 user nova-compute[74882]:     </interface>
Nov 21 14:33:54 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:33:54 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/console.log" append="off"/>
Nov 21 14:33:54 user nova-compute[74882]:     </serial>
Nov 21 14:33:54 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:33:54 user nova-compute[74882]:     <video>
Nov 21 14:33:54 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:33:54 user nova-compute[74882]:     </video>
Nov 21 14:33:54 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:33:54 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:33:54 user nova-compute[74882]:     </rng>
Nov 21 14:33:54 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:33:54 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:33:54 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:33:54 user nova-compute[74882]:     </memballoon>
Nov 21 14:33:54 user nova-compute[74882]:   </devices>
Nov 21 14:33:54 user nova-compute[74882]: </domain>
Nov 21 14:33:54 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:33:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance destroyed successfully.
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:33:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No VIF found with MAC fa:16:3e:6b:07:97, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:33:55 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Instance spawned successfully.
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] No waiting events found dispatching network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:55 user nova-compute[74882]: WARNING nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received unexpected event network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance with vm_state building and task_state spawning.
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:55 user nova-compute[74882]: WARNING nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state active and task_state rescuing.
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:55 user nova-compute[74882]: WARNING nova.compute.manager [req-ae8ec7c4-ddc5-44fc-94de-955a30d95bf7 req-f6ec626b-d8cf-48d1-987e-afd2d0c92af3 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state active and task_state rescuing.
Nov 21 14:33:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:55 user nova-compute[74882]: INFO nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 21 14:33:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:33:55 user nova-compute[74882]: INFO nova.compute.manager [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Took 6.76 seconds to build instance.
Nov 21 14:33:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-093ce22f-bbf5-4c6e-be3a-0a08de04d89d tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.857s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:57 user nova-compute[74882]: WARNING nova.compute.manager [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state active and task_state rescuing.
Nov 21 14:33:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:33:57 user nova-compute[74882]: WARNING nova.compute.manager [req-7061a5f8-262f-468c-a847-b80e88d7f893 req-71bce198-04e2-4663-b1fa-5625cd1562d0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state active and task_state rescuing.
Nov 21 14:33:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2e67fe4a-7948-4414-9544-a70fb2f3f3fa tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:33:59 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Creating image(s)
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Ensure instance console log exists: /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Start _get_guest_xml network_info=[{"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPwQxedW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b4254b1-e8af-479c-9def-a84d4b0838f5', 'attached_at': '', 'detached_at': '', 'volume_id': '06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'serial': '06ecbc30-dd7c-4ae7-a23e-d3f4db85c108'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '625059ac-e64b-4897-8ab6-af12ec6100a2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:33:59 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:59 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPwQxedW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:33:59 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:33:59 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:33:59 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18659c2-c04c-4979-96f4-956f28a4d6cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:33:59 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acfde6f-deff-40b2-904b-25dc1b453361]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108] added
Nov 21 14:33:59 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[13265a67-d261-4ab3-8e3b-bf0cf1090c30]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a70f19-3485-41c8-bdf4-5062098c5df2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPwQxedW {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPwQxedW" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[32064466-f939-4c69-b442-afb0c13e5be5]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OPwQxedW'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d790e-da70-46c6-a49c-6573396ceb4f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[39de5bd7-b579-44cb-9652-378d176e623a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:33:59 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:33:59 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:33:59 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:33:59 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e6aa5d-bf6a-416e-881b-d10929bd2212]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260]
Nov 21 14:33:59 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260] successful.
Nov 21 14:33:59 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c060d7-3178-4d20-95d6-1f393d94d502]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b198f9-a6db-453e-ab23-fc4fde89c3d4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:33:59 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:33:59 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:33:59 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:33:59 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:33:59 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:33:59 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.252s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[780fae0e-c818-40dc-8dc8-dae99614beb4]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:34:00 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:34:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPwQxedW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.659s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== connect_volume: return (1660ms) {'type': 'block', 'scsi_wwn': '26662336366333961', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662336366333961', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1731130822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1731130822',id=33,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-qrccy6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:33:47Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=6b4254b1-e8af-479c-9def-a84d4b0838f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:34:01 user nova-compute[74882]:   <uuid>6b4254b1-e8af-479c-9def-a84d4b0838f5</uuid>
Nov 21 14:34:01 user nova-compute[74882]:   <name>instance-00000021</name>
Nov 21 14:34:01 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:34:01 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:34:01 user nova-compute[74882]:   <metadata>
Nov 21 14:34:01 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:34:01 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:34:01 user nova-compute[74882]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1731130822</nova:name>
Nov 21 14:34:01 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:33:59</nova:creationTime>
Nov 21 14:34:01 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:34:01 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:34:01 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:34:01 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:34:01 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:34:01 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:34:01 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:34:01 user nova-compute[74882]:       <nova:owner>
Nov 21 14:34:01 user nova-compute[74882]:         <nova:user uuid="7635b3029cf14950a1978282d06bc8f3">tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member</nova:user>
Nov 21 14:34:01 user nova-compute[74882]:         <nova:project uuid="96e5113ec65d46c4b8859c4658433b02">tempest-ServerBootFromVolumeStableRescueTest-1086017756</nova:project>
Nov 21 14:34:01 user nova-compute[74882]:       </nova:owner>
Nov 21 14:34:01 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:34:01 user nova-compute[74882]:       <nova:ports>
Nov 21 14:34:01 user nova-compute[74882]:         <nova:port uuid="d01918fa-7533-4b43-95ca-1baa184edfdc">
Nov 21 14:34:01 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:34:01 user nova-compute[74882]:         </nova:port>
Nov 21 14:34:01 user nova-compute[74882]:       </nova:ports>
Nov 21 14:34:01 user nova-compute[74882]:     </nova:instance>
Nov 21 14:34:01 user nova-compute[74882]:   </metadata>
Nov 21 14:34:01 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:34:01 user nova-compute[74882]:     <system>
Nov 21 14:34:01 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:34:01 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:34:01 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:34:01 user nova-compute[74882]:       <entry name="serial">6b4254b1-e8af-479c-9def-a84d4b0838f5</entry>
Nov 21 14:34:01 user nova-compute[74882]:       <entry name="uuid">6b4254b1-e8af-479c-9def-a84d4b0838f5</entry>
Nov 21 14:34:01 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:34:01 user nova-compute[74882]:     </system>
Nov 21 14:34:01 user nova-compute[74882]:   </sysinfo>
Nov 21 14:34:01 user nova-compute[74882]:   <os>
Nov 21 14:34:01 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:34:01 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:34:01 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:34:01 user nova-compute[74882]:   </os>
Nov 21 14:34:01 user nova-compute[74882]:   <features>
Nov 21 14:34:01 user nova-compute[74882]:     <acpi/>
Nov 21 14:34:01 user nova-compute[74882]:     <apic/>
Nov 21 14:34:01 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:34:01 user nova-compute[74882]:   </features>
Nov 21 14:34:01 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:34:01 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:34:01 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:34:01 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:34:01 user nova-compute[74882]:   </clock>
Nov 21 14:34:01 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:34:01 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:34:01 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:34:01 user nova-compute[74882]:   </cpu>
Nov 21 14:34:01 user nova-compute[74882]:   <devices>
Nov 21 14:34:01 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:34:01 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:34:01 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 14:34:01 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:34:01 user nova-compute[74882]:       <serial>06ecbc30-dd7c-4ae7-a23e-d3f4db85c108</serial>
Nov 21 14:34:01 user nova-compute[74882]:     </disk>
Nov 21 14:34:01 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:34:01 user nova-compute[74882]:       <mac address="fa:16:3e:ac:55:32"/>
Nov 21 14:34:01 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:34:01 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:34:01 user nova-compute[74882]:       <target dev="tapd01918fa-75"/>
Nov 21 14:34:01 user nova-compute[74882]:     </interface>
Nov 21 14:34:01 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:34:01 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/console.log" append="off"/>
Nov 21 14:34:01 user nova-compute[74882]:     </serial>
Nov 21 14:34:01 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:34:01 user nova-compute[74882]:     <video>
Nov 21 14:34:01 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:34:01 user nova-compute[74882]:     </video>
Nov 21 14:34:01 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:34:01 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:34:01 user nova-compute[74882]:     </rng>
Nov 21 14:34:01 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:34:01 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:34:01 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:34:01 user nova-compute[74882]:     </memballoon>
Nov 21 14:34:01 user nova-compute[74882]:   </devices>
Nov 21 14:34:01 user nova-compute[74882]: </domain>
Nov 21 14:34:01 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1731130822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1731130822',id=33,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-qrccy6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:33:47Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=6b4254b1-e8af-479c-9def-a84d4b0838f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG os_vif [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43bd75f4-2b99-5900-94f6-60d0f7deb467', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd01918fa-75, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd01918fa-75, col_values=(('qos', UUID('6ff5b5c4-44ff-439c-b517-d4a37bac51f0')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd01918fa-75, col_values=(('external_ids', {'iface-id': 'd01918fa-7533-4b43-95ca-1baa184edfdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:55:32', 'vm-uuid': '6b4254b1-e8af-479c-9def-a84d4b0838f5'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:01 user nova-compute[74882]: INFO os_vif [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75')
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:34:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No VIF found with MAC fa:16:3e:ac:55:32, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:34:02 user nova-compute[74882]: WARNING nova.compute.manager [req-d9c2e378-a6b1-416e-8ee5-1b49d13f3339 req-f4f5470a-7a91-4601-87a5-d807a2ddb087 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state building and task_state spawning.
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:34:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance spawned successfully.
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:04 user nova-compute[74882]: INFO nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:34:04 user nova-compute[74882]: WARNING nova.compute.manager [req-0091519c-8d4e-4059-8050-b122875fb926 req-e458e554-56ba-43f7-9737-6ee469b602f8 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state building and task_state spawning.
Nov 21 14:34:05 user nova-compute[74882]: INFO nova.compute.manager [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Took 19.01 seconds to build instance.
Nov 21 14:34:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d98e3f1-7cc7-488e-b355-fe042c8e5071 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.142s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid cdeb200f-cb4f-4916-8fef-b35ff231d033 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 9a6ece97-45cb-4033-8590-e97182af0a42 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 5a754e62-be65-4faa-a27c-0e4f3b02c842 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "2aae795d-f5f9-4285-a6cf-6e19ec668373" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:34:24 user nova-compute[74882]: INFO nova.compute.claims [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Claim successful on node user
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.841s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:34:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:34:25 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:34:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG nova.policy [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec5849af9af64b3cae0841a5393948a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dd4f5f58c346d396383b8ebb48c021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:34:25 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Creating image(s)
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "/opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "/opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "/opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.264s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk 1073741824" returned: 0 in 0.125s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Successfully created port: a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:34:25 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Cannot resize image /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Ensure instance console log exists: /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Successfully updated port: a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received event network-changed-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Refreshing instance network info cache due to event network-changed-a1f48f06-d7ec-40e1-9bfb-00349f851ed9. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Acquiring lock "refresh_cache-2aae795d-f5f9-4285-a6cf-6e19ec668373" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Acquired lock "refresh_cache-2aae795d-f5f9-4285-a6cf-6e19ec668373" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:34:26 user nova-compute[74882]: DEBUG nova.network.neutron [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Refreshing network info cache for port a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "refresh_cache-2aae795d-f5f9-4285-a6cf-6e19ec668373" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG nova.network.neutron [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG nova.network.neutron [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cbc9308e-9d94-45a1-8938-7d28118e614d req-2361d888-50be-41a4-978e-5e11b0c99d8c service nova] Releasing lock "refresh_cache-2aae795d-f5f9-4285-a6cf-6e19ec668373" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquired lock "refresh_cache-2aae795d-f5f9-4285-a6cf-6e19ec668373" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:34:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Updating instance_info_cache with network_info: [{"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Releasing lock "refresh_cache-2aae795d-f5f9-4285-a6cf-6e19ec668373" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Instance network_info: |[{"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Start _get_guest_xml network_info=[{"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-645232623',display_name='tempest-VolumesActionsTest-instance-645232623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-645232623',id=35,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1dd4f5f58c346d396383b8ebb48c021',ramdisk_id='',reservation_id='r-g0vl59j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-602854423',owner_user_name='tempest-VolumesActionsTest-602854423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:34:25Z,user_data=None,user_id='ec5849af9af64b3cae0841a5393948a3',uuid=2aae795d-f5f9-4285-a6cf-6e19ec668373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Converting VIF {"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=a1f48f06-d7ec-40e1-9bfb-00349f851ed9,network=Network(35d5d62e-2b8e-40c7-bc6a-cc2149e5109c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f48f06-d7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lazy-loading 'pci_devices' on Instance uuid 2aae795d-f5f9-4285-a6cf-6e19ec668373 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:34:28 user nova-compute[74882]:   <uuid>2aae795d-f5f9-4285-a6cf-6e19ec668373</uuid>
Nov 21 14:34:28 user nova-compute[74882]:   <name>instance-00000023</name>
Nov 21 14:34:28 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:34:28 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:34:28 user nova-compute[74882]:   <metadata>
Nov 21 14:34:28 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:34:28 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:34:28 user nova-compute[74882]:       <nova:name>tempest-VolumesActionsTest-instance-645232623</nova:name>
Nov 21 14:34:28 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:34:28</nova:creationTime>
Nov 21 14:34:28 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:34:28 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:34:28 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:34:28 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:34:28 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:34:28 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:34:28 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:34:28 user nova-compute[74882]:       <nova:owner>
Nov 21 14:34:28 user nova-compute[74882]:         <nova:user uuid="ec5849af9af64b3cae0841a5393948a3">tempest-VolumesActionsTest-602854423-project-member</nova:user>
Nov 21 14:34:28 user nova-compute[74882]:         <nova:project uuid="f1dd4f5f58c346d396383b8ebb48c021">tempest-VolumesActionsTest-602854423</nova:project>
Nov 21 14:34:28 user nova-compute[74882]:       </nova:owner>
Nov 21 14:34:28 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:34:28 user nova-compute[74882]:       <nova:ports>
Nov 21 14:34:28 user nova-compute[74882]:         <nova:port uuid="a1f48f06-d7ec-40e1-9bfb-00349f851ed9">
Nov 21 14:34:28 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 21 14:34:28 user nova-compute[74882]:         </nova:port>
Nov 21 14:34:28 user nova-compute[74882]:       </nova:ports>
Nov 21 14:34:28 user nova-compute[74882]:     </nova:instance>
Nov 21 14:34:28 user nova-compute[74882]:   </metadata>
Nov 21 14:34:28 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:34:28 user nova-compute[74882]:     <system>
Nov 21 14:34:28 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:34:28 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:34:28 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:34:28 user nova-compute[74882]:       <entry name="serial">2aae795d-f5f9-4285-a6cf-6e19ec668373</entry>
Nov 21 14:34:28 user nova-compute[74882]:       <entry name="uuid">2aae795d-f5f9-4285-a6cf-6e19ec668373</entry>
Nov 21 14:34:28 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:34:28 user nova-compute[74882]:     </system>
Nov 21 14:34:28 user nova-compute[74882]:   </sysinfo>
Nov 21 14:34:28 user nova-compute[74882]:   <os>
Nov 21 14:34:28 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:34:28 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:34:28 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:34:28 user nova-compute[74882]:   </os>
Nov 21 14:34:28 user nova-compute[74882]:   <features>
Nov 21 14:34:28 user nova-compute[74882]:     <acpi/>
Nov 21 14:34:28 user nova-compute[74882]:     <apic/>
Nov 21 14:34:28 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:34:28 user nova-compute[74882]:   </features>
Nov 21 14:34:28 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:34:28 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:34:28 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:34:28 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:34:28 user nova-compute[74882]:   </clock>
Nov 21 14:34:28 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:34:28 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:34:28 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:34:28 user nova-compute[74882]:   </cpu>
Nov 21 14:34:28 user nova-compute[74882]:   <devices>
Nov 21 14:34:28 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:34:28 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:34:28 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk"/>
Nov 21 14:34:28 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:34:28 user nova-compute[74882]:     </disk>
Nov 21 14:34:28 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:34:28 user nova-compute[74882]:       <mac address="fa:16:3e:0a:d0:b5"/>
Nov 21 14:34:28 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:34:28 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:34:28 user nova-compute[74882]:       <target dev="tapa1f48f06-d7"/>
Nov 21 14:34:28 user nova-compute[74882]:     </interface>
Nov 21 14:34:28 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:34:28 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/console.log" append="off"/>
Nov 21 14:34:28 user nova-compute[74882]:     </serial>
Nov 21 14:34:28 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:34:28 user nova-compute[74882]:     <video>
Nov 21 14:34:28 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:34:28 user nova-compute[74882]:     </video>
Nov 21 14:34:28 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:34:28 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:34:28 user nova-compute[74882]:     </rng>
Nov 21 14:34:28 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:34:28 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:34:28 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:34:28 user nova-compute[74882]:     </memballoon>
Nov 21 14:34:28 user nova-compute[74882]:   </devices>
Nov 21 14:34:28 user nova-compute[74882]: </domain>
Nov 21 14:34:28 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-645232623',display_name='tempest-VolumesActionsTest-instance-645232623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-645232623',id=35,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1dd4f5f58c346d396383b8ebb48c021',ramdisk_id='',reservation_id='r-g0vl59j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-602854423',owner_user_name='tempest-VolumesActionsTest-602854423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:34:25Z,user_data=None,user_id='ec5849af9af64b3cae0841a5393948a3',uuid=2aae795d-f5f9-4285-a6cf-6e19ec668373,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Converting VIF {"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=a1f48f06-d7ec-40e1-9bfb-00349f851ed9,network=Network(35d5d62e-2b8e-40c7-bc6a-cc2149e5109c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f48f06-d7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG os_vif [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=a1f48f06-d7ec-40e1-9bfb-00349f851ed9,network=Network(35d5d62e-2b8e-40c7-bc6a-cc2149e5109c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f48f06-d7') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4921a3a4-0f28-5d46-80fe-bb3dbc2be94a', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1f48f06-d7, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1f48f06-d7, col_values=(('qos', UUID('544918f2-1ec5-4e90-be2a-cd399e6d56ef')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1f48f06-d7, col_values=(('external_ids', {'iface-id': 'a1f48f06-d7ec-40e1-9bfb-00349f851ed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:d0:b5', 'vm-uuid': '2aae795d-f5f9-4285-a6cf-6e19ec668373'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:28 user nova-compute[74882]: INFO os_vif [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=a1f48f06-d7ec-40e1-9bfb-00349f851ed9,network=Network(35d5d62e-2b8e-40c7-bc6a-cc2149e5109c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f48f06-d7')
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] No VIF found with MAC fa:16:3e:0a:d0:b5, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:34:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received event network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Acquiring lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] No waiting events found dispatching network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:34:32 user nova-compute[74882]: WARNING nova.compute.manager [req-7f4d61a9-9fb0-4477-82c3-3904f0efd81c req-5a0dc59e-a1aa-4b40-8140-6c35393faa54 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received unexpected event network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance with vm_state building and task_state spawning.
Nov 21 14:34:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received event network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Acquiring lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] No waiting events found dispatching network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:34:34 user nova-compute[74882]: WARNING nova.compute.manager [req-99dc868e-4f0c-4b56-a09a-d01c2ffecb19 req-f678a82d-50af-4101-b79b-d2c47408f0c1 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received unexpected event network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance with vm_state building and task_state spawning.
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:34:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Instance spawned successfully.
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:34:34 user nova-compute[74882]: INFO nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Took 9.18 seconds to spawn the instance on the hypervisor.
Nov 21 14:34:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:34:34 user nova-compute[74882]: INFO nova.compute.manager [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Took 10.53 seconds to build instance.
Nov 21 14:34:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8beaf1fd-8a87-4a40-874d-7b242a8ad6a7 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.634s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:41 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:34:41 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7733MB free_disk=25.191410064697266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 20630cb7-62c9-4e13-86a7-2432ed79368a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:34:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:34:42 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:34:42 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:34:42 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:34:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:34:46 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:34:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:34:46 user nova-compute[74882]: INFO nova.compute.manager [None req-848e3324-df39-4e26-b7ed-c75cf2f9cd39 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Get console output
Nov 21 14:34:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:34:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:34:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:34:46 user nova-compute[74882]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 21 14:34:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:34:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:34:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:34:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:34:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:34:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:58 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:34:58 user nova-compute[74882]: INFO nova.compute.claims [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Claim successful on node user
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:34:59 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.policy [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:34:59 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Creating image(s)
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "/opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "/opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk 1073741824" returned: 0 in 0.048s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:34:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.190s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Successfully created port: 2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Cannot resize image /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Ensure instance console log exists: /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Successfully updated port: 2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquired lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-changed-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Refreshing instance network info cache due to event network-changed-2173b2c8-e047-4709-ab98-0e5f6d077f8c. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Acquiring lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:35:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updating instance_info_cache with network_info: [{"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Releasing lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Instance network_info: |[{"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Acquired lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Refreshing network info cache for port 2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Start _get_guest_xml network_info=[{"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:35:01 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:35:01 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-744241441',display_name='tempest-TestStampPattern-server-744241441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-744241441',id=36,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH5NG9mjIsga52s0kRKH9IrZe7eb8u0uHJimILwFq6gc6XeS9P2KhDI3bZMrALH0JW9EBkiPZJdps54hxAky6TAI2RrDSglRCp0u6RTSK0kGXjhWDxXPScCdj6QO4CfoQ==',key_name='tempest-TestStampPattern-124603786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce558a840a8c4055a42b197328a0d13a',ramdisk_id='',reservation_id='r-g7lazw2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1219016270',owner_user_name='tempest-TestStampPattern-1219016270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:34:59Z,user_data=None,user_id='eafb1966d06e4d688566d1b5af779c17',uuid=1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converting VIF {"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:76:39,bridge_name='br-int',has_traffic_filtering=True,id=2173b2c8-e047-4709-ab98-0e5f6d077f8c,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2173b2c8-e0') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:35:01 user nova-compute[74882]:   <uuid>1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff</uuid>
Nov 21 14:35:01 user nova-compute[74882]:   <name>instance-00000024</name>
Nov 21 14:35:01 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:35:01 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:35:01 user nova-compute[74882]:   <metadata>
Nov 21 14:35:01 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:35:01 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:35:01 user nova-compute[74882]:       <nova:name>tempest-TestStampPattern-server-744241441</nova:name>
Nov 21 14:35:01 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:35:01</nova:creationTime>
Nov 21 14:35:01 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:35:01 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:35:01 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:35:01 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:35:01 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:35:01 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:35:01 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:35:01 user nova-compute[74882]:       <nova:owner>
Nov 21 14:35:01 user nova-compute[74882]:         <nova:user uuid="eafb1966d06e4d688566d1b5af779c17">tempest-TestStampPattern-1219016270-project-member</nova:user>
Nov 21 14:35:01 user nova-compute[74882]:         <nova:project uuid="ce558a840a8c4055a42b197328a0d13a">tempest-TestStampPattern-1219016270</nova:project>
Nov 21 14:35:01 user nova-compute[74882]:       </nova:owner>
Nov 21 14:35:01 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:35:01 user nova-compute[74882]:       <nova:ports>
Nov 21 14:35:01 user nova-compute[74882]:         <nova:port uuid="2173b2c8-e047-4709-ab98-0e5f6d077f8c">
Nov 21 14:35:01 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 21 14:35:01 user nova-compute[74882]:         </nova:port>
Nov 21 14:35:01 user nova-compute[74882]:       </nova:ports>
Nov 21 14:35:01 user nova-compute[74882]:     </nova:instance>
Nov 21 14:35:01 user nova-compute[74882]:   </metadata>
Nov 21 14:35:01 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:35:01 user nova-compute[74882]:     <system>
Nov 21 14:35:01 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:35:01 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:35:01 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:35:01 user nova-compute[74882]:       <entry name="serial">1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff</entry>
Nov 21 14:35:01 user nova-compute[74882]:       <entry name="uuid">1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff</entry>
Nov 21 14:35:01 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:35:01 user nova-compute[74882]:     </system>
Nov 21 14:35:01 user nova-compute[74882]:   </sysinfo>
Nov 21 14:35:01 user nova-compute[74882]:   <os>
Nov 21 14:35:01 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:35:01 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:35:01 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:35:01 user nova-compute[74882]:   </os>
Nov 21 14:35:01 user nova-compute[74882]:   <features>
Nov 21 14:35:01 user nova-compute[74882]:     <acpi/>
Nov 21 14:35:01 user nova-compute[74882]:     <apic/>
Nov 21 14:35:01 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:35:01 user nova-compute[74882]:   </features>
Nov 21 14:35:01 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:35:01 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:35:01 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:35:01 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:35:01 user nova-compute[74882]:   </clock>
Nov 21 14:35:01 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:35:01 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:35:01 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:35:01 user nova-compute[74882]:   </cpu>
Nov 21 14:35:01 user nova-compute[74882]:   <devices>
Nov 21 14:35:01 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:35:01 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:35:01 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk"/>
Nov 21 14:35:01 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:35:01 user nova-compute[74882]:     </disk>
Nov 21 14:35:01 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:35:01 user nova-compute[74882]:       <mac address="fa:16:3e:ee:76:39"/>
Nov 21 14:35:01 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:35:01 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:35:01 user nova-compute[74882]:       <target dev="tap2173b2c8-e0"/>
Nov 21 14:35:01 user nova-compute[74882]:     </interface>
Nov 21 14:35:01 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:35:01 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/console.log" append="off"/>
Nov 21 14:35:01 user nova-compute[74882]:     </serial>
Nov 21 14:35:01 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:35:01 user nova-compute[74882]:     <video>
Nov 21 14:35:01 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:35:01 user nova-compute[74882]:     </video>
Nov 21 14:35:01 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:35:01 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:35:01 user nova-compute[74882]:     </rng>
Nov 21 14:35:01 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:35:01 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:35:01 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:35:01 user nova-compute[74882]:     </memballoon>
Nov 21 14:35:01 user nova-compute[74882]:   </devices>
Nov 21 14:35:01 user nova-compute[74882]: </domain>
Nov 21 14:35:01 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-744241441',display_name='tempest-TestStampPattern-server-744241441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-744241441',id=36,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH5NG9mjIsga52s0kRKH9IrZe7eb8u0uHJimILwFq6gc6XeS9P2KhDI3bZMrALH0JW9EBkiPZJdps54hxAky6TAI2RrDSglRCp0u6RTSK0kGXjhWDxXPScCdj6QO4CfoQ==',key_name='tempest-TestStampPattern-124603786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce558a840a8c4055a42b197328a0d13a',ramdisk_id='',reservation_id='r-g7lazw2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1219016270',owner_user_name='tempest-TestStampPattern-1219016270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:34:59Z,user_data=None,user_id='eafb1966d06e4d688566d1b5af779c17',uuid=1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converting VIF {"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:76:39,bridge_name='br-int',has_traffic_filtering=True,id=2173b2c8-e047-4709-ab98-0e5f6d077f8c,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2173b2c8-e0') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG os_vif [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:76:39,bridge_name='br-int',has_traffic_filtering=True,id=2173b2c8-e047-4709-ab98-0e5f6d077f8c,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2173b2c8-e0') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b08d380-7aff-5c3f-b6ea-be48557cef70', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2173b2c8-e0, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2173b2c8-e0, col_values=(('qos', UUID('bd3d0e0a-ba45-40a7-9f3b-10d2109b3fa4')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2173b2c8-e0, col_values=(('external_ids', {'iface-id': '2173b2c8-e047-4709-ab98-0e5f6d077f8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:76:39', 'vm-uuid': '1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:01 user nova-compute[74882]: INFO os_vif [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:76:39,bridge_name='br-int',has_traffic_filtering=True,id=2173b2c8-e047-4709-ab98-0e5f6d077f8c,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2173b2c8-e0')
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No VIF found with MAC fa:16:3e:ee:76:39, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updated VIF entry in instance network info cache for port 2173b2c8-e047-4709-ab98-0e5f6d077f8c. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updating instance_info_cache with network_info: [{"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:35:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8e2d37d9-6308-4f7e-9105-9ffd36edd43c req-2577ae84-e335-44e6-bdd7-bb04efb59d27 service nova] Releasing lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] No waiting events found dispatching network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:02 user nova-compute[74882]: WARNING nova.compute.manager [req-989f286f-4d11-4920-97ec-aa9a25f81e1c req-ba68ff1e-3e7f-45ce-bec4-62348c9538ef service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received unexpected event network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance with vm_state building and task_state spawning.
Nov 21 14:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:35:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Instance spawned successfully.
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:35:04 user nova-compute[74882]: INFO nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] No waiting events found dispatching network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:04 user nova-compute[74882]: WARNING nova.compute.manager [req-43f4b6c5-2998-4905-b935-7e2bf3419661 req-f5bceb7e-fc09-4bb3-9ad1-1d1d6e13fe4b service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received unexpected event network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance with vm_state building and task_state spawning.
Nov 21 14:35:04 user nova-compute[74882]: INFO nova.compute.manager [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Took 6.30 seconds to build instance.
Nov 21 14:35:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6e96a18-4055-4e76-90a2-c59a57f682de tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:36 user nova-compute[74882]: INFO nova.compute.manager [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Rescuing
Nov 21 14:35:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:35:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:35:36 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:35:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:36 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Updating instance_info_cache with network_info: [{"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:35:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:35:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:37 user nova-compute[74882]: WARNING nova.compute.manager [req-f136fceb-2388-4784-a546-a67b550da734 req-096dfb0f-26ed-47da-a64a-8a5ffb712e47 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state active and task_state rescuing.
Nov 21 14:35:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance destroyed successfully.
Nov 21 14:35:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Attempting a stable device rescue
Nov 21 14:35:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74882) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:35:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Creating image(s)
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "/opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "532a1f822805da8cb863779c51f592e723f8c876" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "532a1f822805da8cb863779c51f592e723f8c876" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:38 user nova-compute[74882]: DEBUG nova.virt.images [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] e5a45695-41fb-453d-bd83-e1322c4fadbc was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:35:38 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:35:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.part /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.part /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.converted" returned: 0 in 0.281s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:39 user nova-compute[74882]: WARNING nova.compute.manager [req-a25b5004-dfcd-492a-a96f-617170ebd06c req-904647a0-4aed-440f-878c-3eda03ee8339 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state active and task_state rescuing.
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "532a1f822805da8cb863779c51f592e723f8c876" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.623s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "532a1f822805da8cb863779c51f592e723f8c876" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "532a1f822805da8cb863779c51f592e723f8c876" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876 --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876,backing_fmt=raw /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876,backing_fmt=raw /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue" returned: 0 in 0.064s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "532a1f822805da8cb863779c51f592e723f8c876" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'migration_context' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<6b4254b1-e8af-479c-9def-a84d4b0838f5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Start _get_guest_xml network_info=[{"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "vif_mac": "fa:16:3e:ac:55:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e5a45695-41fb-453d-bd83-e1322c4fadbc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPwQxedW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6b4254b1-e8af-479c-9def-a84d4b0838f5', 'attached_at': '', 'detached_at': '', 'volume_id': '06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'serial': '06ecbc30-dd7c-4ae7-a23e-d3f4db85c108'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '625059ac-e64b-4897-8ab6-af12ec6100a2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'resources' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<6b4254b1-e8af-479c-9def-a84d4b0838f5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<6b4254b1-e8af-479c-9def-a84d4b0838f5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:35:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:35:39 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<6b4254b1-e8af-479c-9def-a84d4b0838f5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPwQxedW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:35:39 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:35:39 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:35:39 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a46fe-748a-4a0a-917e-e453d4086720]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OPwQxedW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 21 14:35:39 user nova-compute[74882]: node.name = iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108
Nov 21 14:35:39 user nova-compute[74882]: node.tpgt = -1
Nov 21 14:35:39 user nova-compute[74882]: node.startup = automatic
Nov 21 14:35:39 user nova-compute[74882]: node.leading_login = No
Nov 21 14:35:39 user nova-compute[74882]: iface.iscsi_ifacename = default
Nov 21 14:35:39 user nova-compute[74882]: iface.net_ifacename = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.ipaddress = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.prefix_len = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.hwaddress = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.transport_name = tcp
Nov 21 14:35:39 user nova-compute[74882]: iface.initiatorname = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.state = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.vlan_id = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.vlan_priority = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.vlan_state = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.iface_num = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.mtu = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.port = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.bootproto = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.subnet_mask = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.gateway = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_alt_client_id_state = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_alt_client_id = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_dns = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_learn_iqn = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_req_vendor_id_state = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_vendor_id_state = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_vendor_id = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.dhcp_slp_da = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.fragmentation = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.gratuitous_arp = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.incoming_forwarding = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.tos_state = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.tos = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.ttl = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.delayed_ack = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.tcp_nagle = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.tcp_wsf_state = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.tcp_wsf = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.tcp_timer_scale = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.tcp_timestamp = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.redirect = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.def_task_mgmt_timeout = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.header_digest = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.data_digest = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.immediate_data = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.initial_r2t = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.data_seq_inorder = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.data_pdu_inorder = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.erl = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.max_receive_data_len = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.first_burst_len = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.max_outstanding_r2t = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.max_burst_len = 0
Nov 21 14:35:39 user nova-compute[74882]: iface.chap_auth = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.bidi_chap = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.strict_login_compliance = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.discovery_auth = <empty>
Nov 21 14:35:39 user nova-compute[74882]: iface.discovery_logout = <empty>
Nov 21 14:35:39 user nova-compute[74882]: node.discovery_address = <empty>
Nov 21 14:35:39 user nova-compute[74882]: node.discovery_port = 0
Nov 21 14:35:39 user nova-compute[74882]: node.discovery_type = static
Nov 21 14:35:39 user nova-compute[74882]: node.session.initial_cmdsn = 0
Nov 21 14:35:39 user nova-compute[74882]: node.session.initial_login_retry_max = 8
Nov 21 14:35:39 user nova-compute[74882]: node.session.xmit_thread_priority = -20
Nov 21 14:35:39 user nova-compute[74882]: node.session.cmds_max = 128
Nov 21 14:35:39 user nova-compute[74882]: node.session.queue_depth = 32
Nov 21 14:35:39 user nova-compute[74882]: node.session.nr_sessions = 1
Nov 21 14:35:39 user nova-compute[74882]: node.session.auth.authmethod = CHAP
Nov 21 14:35:39 user nova-compute[74882]: node.session.auth.username = OPwQxedW
Nov 21 14:35:39 user nova-compute[74882]: node.session.auth.password = ***
Nov 21 14:35:39 user nova-compute[74882]: node.session.auth.username_in = <empty>
Nov 21 14:35:39 user nova-compute[74882]: node.session.auth.password_in = <empty>
Nov 21 14:35:39 user nova-compute[74882]: node.session.auth.chap_algs = MD5
Nov 21 14:35:39 user nova-compute[74882]: node.session.timeo.replacement_timeout = 120
Nov 21 14:35:39 user nova-compute[74882]: node.session.err_timeo.abort_timeout = 15
Nov 21 14:35:39 user nova-compute[74882]: node.session.err_timeo.lu_reset_timeout = 30
Nov 21 14:35:39 user nova-compute[74882]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 21 14:35:39 user nova-compute[74882]: node.session.err_timeo.host_reset_timeout = 60
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.FastAbort = Yes
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.InitialR2T = No
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.ImmediateData = Yes
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.FirstBurstLength = 262144
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.MaxBurstLength = 16776192
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.DefaultTime2Retain = 0
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.DefaultTime2Wait = 2
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.MaxConnections = 1
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 21 14:35:39 user nova-compute[74882]: node.session.iscsi.ERL = 0
Nov 21 14:35:39 user nova-compute[74882]: node.session.scan = manual
Nov 21 14:35:39 user nova-compute[74882]: node.session.reopen_max = 0
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].address = 172.16.0.220
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].port = 3260
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].startup = manual
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].tcp.window_size = 524288
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].tcp.type_of_service = 0
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].timeo.logout_timeout = 15
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].timeo.login_timeout = 15
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].timeo.auth_timeout = 45
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].timeo.noop_out_interval = 5
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].timeo.noop_out_timeout = 5
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].iscsi.HeaderDigest = None
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].iscsi.DataDigest = None
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].iscsi.IFMarker = No
Nov 21 14:35:39 user nova-compute[74882]: node.conn[0].iscsi.OFMarker = No
Nov 21 14:35:39 user nova-compute[74882]: # END RECORD
Nov 21 14:35:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[561dd845-626c-42e4-adc8-58ecd0688166]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68485c2-3f89-4e49-bd5e-bfe058412d7c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPwQxedW {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPwQxedW" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7993bcd9-e598-4af0-bf08-16a13b5a1348]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OPwQxedW'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b48138e-d675-4619-a907-d354d89fdc51]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e257d089-302a-4b3b-b2f7-6b343093f9d1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:39 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:39 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:39 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:39 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:39 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] HCTL ('34', '0', '0', 0) found on session 43 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975fd81-b84e-4937-841e-6819b850cfa1]: (4, ('0 0 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Searching for a device in session 43 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPwQxedW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '26662336366333961', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662336366333961', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1731130822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1731130822',id=33,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-qrccy6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:34:05Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=6b4254b1-e8af-479c-9def-a84d4b0838f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "vif_mac": "fa:16:3e:ac:55:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "vif_mac": "fa:16:3e:ac:55:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Object Instance<6b4254b1-e8af-479c-9def-a84d4b0838f5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:35:39 user nova-compute[74882]:   <uuid>6b4254b1-e8af-479c-9def-a84d4b0838f5</uuid>
Nov 21 14:35:39 user nova-compute[74882]:   <name>instance-00000021</name>
Nov 21 14:35:39 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:35:39 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:35:39 user nova-compute[74882]:   <metadata>
Nov 21 14:35:39 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:35:39 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:35:39 user nova-compute[74882]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1731130822</nova:name>
Nov 21 14:35:39 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:35:39</nova:creationTime>
Nov 21 14:35:39 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:35:39 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:35:39 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:35:39 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:35:39 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:35:39 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:35:39 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:35:39 user nova-compute[74882]:       <nova:owner>
Nov 21 14:35:39 user nova-compute[74882]:         <nova:user uuid="7635b3029cf14950a1978282d06bc8f3">tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member</nova:user>
Nov 21 14:35:39 user nova-compute[74882]:         <nova:project uuid="96e5113ec65d46c4b8859c4658433b02">tempest-ServerBootFromVolumeStableRescueTest-1086017756</nova:project>
Nov 21 14:35:39 user nova-compute[74882]:       </nova:owner>
Nov 21 14:35:39 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:35:39 user nova-compute[74882]:       <nova:ports>
Nov 21 14:35:39 user nova-compute[74882]:         <nova:port uuid="d01918fa-7533-4b43-95ca-1baa184edfdc">
Nov 21 14:35:39 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:35:39 user nova-compute[74882]:         </nova:port>
Nov 21 14:35:39 user nova-compute[74882]:       </nova:ports>
Nov 21 14:35:39 user nova-compute[74882]:     </nova:instance>
Nov 21 14:35:39 user nova-compute[74882]:   </metadata>
Nov 21 14:35:39 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:35:39 user nova-compute[74882]:     <system>
Nov 21 14:35:39 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:35:39 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:35:39 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:35:39 user nova-compute[74882]:       <entry name="serial">6b4254b1-e8af-479c-9def-a84d4b0838f5</entry>
Nov 21 14:35:39 user nova-compute[74882]:       <entry name="uuid">6b4254b1-e8af-479c-9def-a84d4b0838f5</entry>
Nov 21 14:35:39 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:35:39 user nova-compute[74882]:     </system>
Nov 21 14:35:39 user nova-compute[74882]:   </sysinfo>
Nov 21 14:35:39 user nova-compute[74882]:   <os>
Nov 21 14:35:39 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:35:39 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:35:39 user nova-compute[74882]:   </os>
Nov 21 14:35:39 user nova-compute[74882]:   <features>
Nov 21 14:35:39 user nova-compute[74882]:     <acpi/>
Nov 21 14:35:39 user nova-compute[74882]:     <apic/>
Nov 21 14:35:39 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:35:39 user nova-compute[74882]:   </features>
Nov 21 14:35:39 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:35:39 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:35:39 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:35:39 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:35:39 user nova-compute[74882]:   </clock>
Nov 21 14:35:39 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:35:39 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:35:39 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:35:39 user nova-compute[74882]:   </cpu>
Nov 21 14:35:39 user nova-compute[74882]:   <devices>
Nov 21 14:35:39 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:35:39 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:35:39 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 14:35:39 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:35:39 user nova-compute[74882]:       <serial>06ecbc30-dd7c-4ae7-a23e-d3f4db85c108</serial>
Nov 21 14:35:39 user nova-compute[74882]:     </disk>
Nov 21 14:35:39 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:35:39 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:35:39 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue"/>
Nov 21 14:35:39 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:35:39 user nova-compute[74882]:       <boot order="1"/>
Nov 21 14:35:39 user nova-compute[74882]:     </disk>
Nov 21 14:35:39 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:35:39 user nova-compute[74882]:       <mac address="fa:16:3e:ac:55:32"/>
Nov 21 14:35:39 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:35:39 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:35:39 user nova-compute[74882]:       <target dev="tapd01918fa-75"/>
Nov 21 14:35:39 user nova-compute[74882]:     </interface>
Nov 21 14:35:39 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:35:39 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/console.log" append="off"/>
Nov 21 14:35:39 user nova-compute[74882]:     </serial>
Nov 21 14:35:39 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:35:39 user nova-compute[74882]:     <video>
Nov 21 14:35:39 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:35:39 user nova-compute[74882]:     </video>
Nov 21 14:35:39 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:35:39 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:35:39 user nova-compute[74882]:     </rng>
Nov 21 14:35:39 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:35:39 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:35:39 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:35:39 user nova-compute[74882]:     </memballoon>
Nov 21 14:35:39 user nova-compute[74882]:   </devices>
Nov 21 14:35:39 user nova-compute[74882]: </domain>
Nov 21 14:35:39 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:35:39 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance destroyed successfully.
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] No VIF found with MAC fa:16:3e:ac:55:32, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-changed-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG nova.compute.manager [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Refreshing instance network info cache due to event network-changed-b71689fa-96c5-44a3-9305-2d3504cfc9a3. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Acquiring lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Acquired lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG nova.network.neutron [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Refreshing network info cache for port b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'flavor' on Instance uuid 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:40 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Ignoring supplied device name: /dev/vdb
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG nova.network.neutron [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Updated VIF entry in instance network info cache for port b71689fa-96c5-44a3-9305-2d3504cfc9a3. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG nova.network.neutron [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Updating instance_info_cache with network_info: [{"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f2777288-f0af-4fed-ac66-98ffab2d816e req-4162e5c1-5b06-4b9d-828d-7891791cb6c6 service nova] Releasing lock "refresh_cache-20630cb7-62c9-4e13-86a7-2432ed79368a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:40 user nova-compute[74882]: INFO nova.compute.manager [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Attaching volume f749752e-88d4-4fa9-8487-11423d91fc39 to /dev/vdb
Nov 21 14:35:40 user nova-compute[74882]: DEBUG os_brick.utils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570b81c-2bad-419a-975b-15cb0467a1a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb1e0b-9f85-416f-856a-b71825d2f977]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[17788324-ff0a-4921-a664-81c6a72de75c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0ab4ca-48eb-4278-aea7-d36f499ad42a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:35:40 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:35:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ca32b4-ca4c-4e4c-8008-f16c27882d9e]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG os_brick.utils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:35:40 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Updating existing volume attachment record: bc5e922e-6ca5-49f1-ae9b-27c2c6c9960b {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:41 user nova-compute[74882]: WARNING nova.compute.manager [req-2c473a6e-2e72-4ad0-ad8f-eae66214b2e4 req-fd693d31-3946-4a68-8528-576e41cebbab service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state active and task_state rescuing.
Nov 21 14:35:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:35:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.449s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:43 user nova-compute[74882]: WARNING nova.compute.manager [req-d283a89a-6cb5-480e-b44d-6b29584d4630 req-3856a6fd-370f-413f-ad2a-22e239440dca service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state active and task_state rescuing.
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4aa2ac97-c353-44e5-8b0d-1c7fc26fe4e0 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:35:43 user nova-compute[74882]: INFO nova.compute.manager [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Unrescuing
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG nova.objects.instance [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:44 user nova-compute[74882]: WARNING nova.compute.manager [req-f17e5041-bd41-48b7-9ca0-c65cdda6c899 req-2c687788-f430-4c3c-9edc-689c04060b2d service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:35:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance destroyed successfully.
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:46 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:35:46 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=25.03817367553711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 9a6ece97-45cb-4033-8590-e97182af0a42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 20630cb7-62c9-4e13-86a7-2432ed79368a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2aae795d-f5f9-4285-a6cf-6e19ec668373 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:46 user nova-compute[74882]: WARNING nova.compute.manager [req-b156a1f3-5957-4470-a9c4-03cf3eb4e8b5 req-e60f7ad0-92f5-49fd-a922-ea1915afefb0 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:35:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKiMIdlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:35:47 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:35:47 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:35:47 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d110ea-9842-4775-b2af-a1688f91b729]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:35:47 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cafad40-4331-4600-b6c2-8d204c2bb624]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39] added
Nov 21 14:35:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dbc102-734c-4e35-8fa9-edbfd26eb997]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6168e6d3-ac14-446b-b329-d6d561788c18]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKiMIdlT {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKiMIdlT" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3479b8-37d1-4217-9038-591d47638bb9]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKiMIdlT'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd80c522-dead-4990-9878-a5c24b1d48bc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9698e2e-7c86-4b48-98d7-d8982d564970]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c5f28b-17c2-4a6c-9271-9f1517b5be1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260]
Nov 21 14:35:47 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260] successful.
Nov 21 14:35:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f03a84a-b4ca-4965-a22c-b69f09f6a594]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69174d-6593-4332-8c68-650142683cca]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)
Nov 21 14:35:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6353cb-e484-47f2-869e-ca3c30455048]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKiMIdlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:47 user nova-compute[74882]: INFO nova.compute.manager [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Terminating instance
Nov 21 14:35:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:35:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Instance destroyed successfully.
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'resources' on Instance uuid 9a6ece97-45cb-4033-8590-e97182af0a42 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-765597573',display_name='tempest-ServerActionsTestOtherA-server-765597573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-765597573',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-4ukk56w4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:32:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=9a6ece97-45cb-4033-8590-e97182af0a42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "388999f8-b374-406c-9d58-855ff9c23da8", "address": "fa:16:3e:c0:27:22", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap388999f8-b3", "ovs_interfaceid": "388999f8-b374-406c-9d58-855ff9c23da8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_vif [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap388999f8-b3, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ee409be-5f47-44a2-be39-2d92722214c4) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26532613666633738', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532613666633738', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:35:48 user nova-compute[74882]: INFO os_vif [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:27:22,bridge_name='br-int',has_traffic_filtering=True,id=388999f8-b374-406c-9d58-855ff9c23da8,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap388999f8-b3')
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'flavor' on Instance uuid 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ftkdETvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:35:48 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:35:48 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:35:48 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:35:48 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:35:48 user nova-compute[74882]:   <serial>f749752e-88d4-4fa9-8487-11423d91fc39</serial>
Nov 21 14:35:48 user nova-compute[74882]: </disk>
Nov 21 14:35:48 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da36cb7-45e8-4de4-9bb9-d02839ad8d37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:35:48 user nova-compute[74882]: No targets found.
Nov 21 14:35:48 user nova-compute[74882]: iSNS:
Nov 21 14:35:48 user nova-compute[74882]: No targets found.
Nov 21 14:35:48 user nova-compute[74882]: STATIC:
Nov 21 14:35:48 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:35:48 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:35:48 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:35:48 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39
Nov 21 14:35:48 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:35:48 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:35:48 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108
Nov 21 14:35:48 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:35:48 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:35:48 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f
Nov 21 14:35:48 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:35:48 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:35:48 user nova-compute[74882]: FIRMWARE:
Nov 21 14:35:48 user nova-compute[74882]: No targets found.
Nov 21 14:35:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:35:48 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:35:48 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c6e9ae-d2d9-424c-8909-76baaa28cc15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a55ddef-23d4-40bf-8d9a-029ff36d94d4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:48 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:48 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:48 user nova-compute[74882]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)
Nov 21 14:35:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:35:48 user nova-compute[74882]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f (non-flash)
Nov 21 14:35:48 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:35:48 user nova-compute[74882]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)
Nov 21 14:35:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c424700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[10535c4b-e54c-4dc9-9851-484a345a62dc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-unplugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-unplugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-47600ff9-3150-4f38-999c-8b8a05382205 req-33c0aa8f-4439-4b07-96c2-8a7a992561d8 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-unplugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[467f067f-5a5d-478d-b982-775e69a096c9]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9484f08-0f97-4fd1-ad1a-e2bd5c4dfeaa]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:48 user nova-compute[74882]: WARNING nova.compute.manager [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:48 user nova-compute[74882]: WARNING nova.compute.manager [req-9f5db925-5c30-4382-aa20-8a52034718da req-ef37557e-b6ce-4aed-af69-db3b402d7530 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60f69c-5fd3-4cc7-9366-c1cd0807a671]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c54e8fb-dd7d-42e4-92f4-a6e513be0847]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afb83b3-5efc-40ae-871b-6c7a75e7ae6e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260]
Nov 21 14:35:48 user nova-compute[74882]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f, portal: 172.16.0.220,3260] successful.
Nov 21 14:35:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b68b64e-527c-465a-96b2-a2fa96e9cb6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c908c6-17ac-4864-af52-d7944193736b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] <== disconnect_volume: return (371ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:35:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Deleting instance files /opt/stack/data/nova/instances/9a6ece97-45cb-4033-8590-e97182af0a42_del
Nov 21 14:35:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Deletion of /opt/stack/data/nova/instances/9a6ece97-45cb-4033-8590-e97182af0a42_del complete
Nov 21 14:35:48 user nova-compute[74882]: INFO nova.compute.manager [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 21 14:35:48 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No VIF found with MAC fa:16:3e:96:64:35, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:35:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-105110a7-9d2d-4490-8fb4-d775ca93104f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updating instance_info_cache with network_info: [{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c95ff847-6730-462d-a196-559f499a8f70 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.548s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:49 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:35:49 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Took 0.86 seconds to deallocate network for instance.
Nov 21 14:35:50 user nova-compute[74882]: INFO nova.compute.manager [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Took 0.84 seconds to detach 1 volumes for instance.
Nov 21 14:35:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Deleting volume: 5b68b64e-527c-465a-96b2-a2fa96e9cb6f {{(pid=74882) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 21 14:35:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Acquiring lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] Lock "9a6ece97-45cb-4033-8590-e97182af0a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] No waiting events found dispatching network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:35:50 user nova-compute[74882]: WARNING nova.compute.manager [req-76d35faa-8b4c-4a80-b723-9f123608662c req-189676e4-861a-4b6c-a7c6-a3f89101e646 service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received unexpected event network-vif-plugged-388999f8-b374-406c-9d58-855ff9c23da8 for instance with vm_state active and task_state deleting.
Nov 21 14:35:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-5fa6bd26-d517-415f-bddd-2498fa952ece req-42b2e97e-6083-42df-b37e-0fcb1c48bfba service nova] [instance: 9a6ece97-45cb-4033-8590-e97182af0a42] Received event network-vif-deleted-388999f8-b374-406c-9d58-855ff9c23da8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:35:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:35:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:35:51 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:35:51 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:35:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:51 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Deleted allocations for instance 9a6ece97-45cb-4033-8590-e97182af0a42
Nov 21 14:35:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b252141f-4cb6-46c4-b597-7cbfd953ec8c tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "9a6ece97-45cb-4033-8590-e97182af0a42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.736s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:35:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:35:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:09 user nova-compute[74882]: INFO nova.compute.manager [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Detaching volume f749752e-88d4-4fa9-8487-11423d91fc39
Nov 21 14:36:09 user nova-compute[74882]: INFO nova.virt.block_device [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Attempting to driver detach volume f749752e-88d4-4fa9-8487-11423d91fc39 from mountpoint /dev/vdb
Nov 21 14:36:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Attempting to detach device vdb from instance 20630cb7-62c9-4e13-86a7-2432ed79368a from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:36:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:36:09 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:36:09 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:36:09 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:36:09 user nova-compute[74882]:   <serial>f749752e-88d4-4fa9-8487-11423d91fc39</serial>
Nov 21 14:36:09 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:36:09 user nova-compute[74882]: </disk>
Nov 21 14:36:09 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:36:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully detached device vdb from instance 20630cb7-62c9-4e13-86a7-2432ed79368a from the persistent domain config.
Nov 21 14:36:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20630cb7-62c9-4e13-86a7-2432ed79368a from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:36:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:36:09 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:36:09 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:36:09 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:36:09 user nova-compute[74882]:   <serial>f749752e-88d4-4fa9-8487-11423d91fc39</serial>
Nov 21 14:36:09 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:36:09 user nova-compute[74882]: </disk>
Nov 21 14:36:09 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:36:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:36:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "2aae795d-f5f9-4285-a6cf-6e19ec668373" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:20 user nova-compute[74882]: INFO nova.compute.manager [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Terminating instance
Nov 21 14:36:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.compute.manager [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received event network-vif-unplugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Acquiring lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.compute.manager [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] No waiting events found dispatching network-vif-unplugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.compute.manager [req-401b34e8-9e13-4193-b4a3-bf3349de5b8f req-479cebbe-394f-4ba1-8ff2-c5a3c7ec8127 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received event network-vif-unplugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:36:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Instance destroyed successfully.
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.objects.instance [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lazy-loading 'resources' on Instance uuid 2aae795d-f5f9-4285-a6cf-6e19ec668373 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:34:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-645232623',display_name='tempest-VolumesActionsTest-instance-645232623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-645232623',id=35,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:34:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1dd4f5f58c346d396383b8ebb48c021',ramdisk_id='',reservation_id='r-g0vl59j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-602854423',owner_user_name='tempest-VolumesActionsTest-602854423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:34:34Z,user_data=None,user_id='ec5849af9af64b3cae0841a5393948a3',uuid=2aae795d-f5f9-4285-a6cf-6e19ec668373,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Converting VIF {"id": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "address": "fa:16:3e:0a:d0:b5", "network": {"id": "35d5d62e-2b8e-40c7-bc6a-cc2149e5109c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-83389877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1dd4f5f58c346d396383b8ebb48c021", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1f48f06-d7", "ovs_interfaceid": "a1f48f06-d7ec-40e1-9bfb-00349f851ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=a1f48f06-d7ec-40e1-9bfb-00349f851ed9,network=Network(35d5d62e-2b8e-40c7-bc6a-cc2149e5109c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f48f06-d7') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG os_vif [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=a1f48f06-d7ec-40e1-9bfb-00349f851ed9,network=Network(35d5d62e-2b8e-40c7-bc6a-cc2149e5109c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f48f06-d7') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1f48f06-d7, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=544918f2-1ec5-4e90-be2a-cd399e6d56ef) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:36:21 user nova-compute[74882]: INFO os_vif [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:d0:b5,bridge_name='br-int',has_traffic_filtering=True,id=a1f48f06-d7ec-40e1-9bfb-00349f851ed9,network=Network(35d5d62e-2b8e-40c7-bc6a-cc2149e5109c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1f48f06-d7')
Nov 21 14:36:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Deleting instance files /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373_del
Nov 21 14:36:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Deletion of /opt/stack/data/nova/instances/2aae795d-f5f9-4285-a6cf-6e19ec668373_del complete
Nov 21 14:36:21 user nova-compute[74882]: INFO nova.compute.manager [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 21 14:36:21 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:36:21 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Took 0.39 seconds to deallocate network for instance.
Nov 21 14:36:21 user nova-compute[74882]: DEBUG nova.compute.manager [req-e94b4d41-259e-447b-bf1a-87f5d57bad03 req-94e3d6a2-9978-4361-8476-c82d3d6283e7 service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received event network-vif-deleted-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:22 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:36:22 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:36:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:22 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Deleted allocations for instance 2aae795d-f5f9-4285-a6cf-6e19ec668373
Nov 21 14:36:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-85f32004-0293-45b1-b7fa-390a8f609065 tempest-VolumesActionsTest-602854423 tempest-VolumesActionsTest-602854423-project-member] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.596s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received event network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Acquiring lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] Lock "2aae795d-f5f9-4285-a6cf-6e19ec668373-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] No waiting events found dispatching network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:36:23 user nova-compute[74882]: WARNING nova.compute.manager [req-38a722cf-c6de-4246-b475-ac9fab5a67c9 req-989a508d-eae4-4e8d-8980-61ae84be593d service nova] [instance: 2aae795d-f5f9-4285-a6cf-6e19ec668373] Received unexpected event network-vif-plugged-a1f48f06-d7ec-40e1-9bfb-00349f851ed9 for instance with vm_state deleted and task_state None.
Nov 21 14:36:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 20630cb7-62c9-4e13-86a7-2432ed79368a is timed out.
Nov 21 14:36:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully detached device vdb from instance 20630cb7-62c9-4e13-86a7-2432ed79368a from the live domain config.
Nov 21 14:36:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKiMIdlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:36:29 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80b0b2a-1968-45ae-9538-75d644bcb8c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:36:29 user nova-compute[74882]: No targets found.
Nov 21 14:36:29 user nova-compute[74882]: iSNS:
Nov 21 14:36:29 user nova-compute[74882]: No targets found.
Nov 21 14:36:29 user nova-compute[74882]: STATIC:
Nov 21 14:36:29 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:36:29 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:36:29 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:36:29 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39
Nov 21 14:36:29 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:36:29 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:36:29 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108
Nov 21 14:36:29 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:36:29 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:36:29 user nova-compute[74882]: FIRMWARE:
Nov 21 14:36:29 user nova-compute[74882]: No targets found.
Nov 21 14:36:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:36:29 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:36:29 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62bf3a9-4042-49c4-9c7d-174d754a31a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc5882-43d4-4364-b1fb-f9c1fbbd8469]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:29 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:29 user nova-compute[74882]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)
Nov 21 14:36:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:29 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:29 user nova-compute[74882]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 (non-flash)
Nov 21 14:36:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c421ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb264ac5-acc0-4314-bca6-f085d9f93ddc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efed14c-650e-48df-a84c-754053dd2bf3]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fd6e6d-55f3-46b8-bceb-d41705948543]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc1809-cbc9-41a3-8316-0aeccc673e52]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a19521b-8aec-4977-9be6-de0c7046890d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e048a-f852-44d7-9b21-dda9e5ecdb4c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260]
Nov 21 14:36:29 user nova-compute[74882]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39, portal: 172.16.0.220,3260] successful.
Nov 21 14:36:29 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[95517ae1-0ce7-48a5-ab6a-a5def711e14c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== disconnect_volume: return (278ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:36:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG nova.objects.instance [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'flavor' on Instance uuid 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d981e4c7-b2e9-4185-9076-8ff93cefbcaf tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.502s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:30 user nova-compute[74882]: INFO nova.compute.manager [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Terminating instance
Nov 21 14:36:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-vif-unplugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] No waiting events found dispatching network-vif-unplugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:36:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-b80f847e-cd12-470b-b05c-bf8b25667600 req-114bc97c-9990-413a-943e-00b9f1531744 service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-vif-unplugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:36:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Instance destroyed successfully.
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.objects.instance [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'resources' on Instance uuid 20630cb7-62c9-4e13-86a7-2432ed79368a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:33:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1495642543',display_name='tempest-VolumesSnapshotTestJSON-instance-1495642543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1495642543',id=34,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOorQNTa6zgu29HxzWmEkoqhVpSdQf4ZfG77uGHFVBNgLTXqaCSl0pFAJ0Bq3aaAHnqpF80Pd7HIBQXQ67rIYl2dTa7CpM5rgqHaoAFffHONec18YKMUOY1lD0YzpFlI7Q==',key_name='tempest-keypair-832007284',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:33:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eea6fab008a747ef9093b7c92fb27708',ramdisk_id='',reservation_id='r-6lou2ocn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1985664337',owner_user_name='tempest-VolumesSnapshotTestJSON-1985664337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ad8112276648628ce9669c2445ea81',uuid=20630cb7-62c9-4e13-86a7-2432ed79368a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converting VIF {"id": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "address": "fa:16:3e:96:64:35", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71689fa-96", "ovs_interfaceid": "b71689fa-96c5-44a3-9305-2d3504cfc9a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:64:35,bridge_name='br-int',has_traffic_filtering=True,id=b71689fa-96c5-44a3-9305-2d3504cfc9a3,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71689fa-96') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_vif [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:64:35,bridge_name='br-int',has_traffic_filtering=True,id=b71689fa-96c5-44a3-9305-2d3504cfc9a3,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71689fa-96') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb71689fa-96, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04b0ddd1-cfb8-4f2d-b696-aca2d6d8aefe) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:36:31 user nova-compute[74882]: INFO os_vif [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:64:35,bridge_name='br-int',has_traffic_filtering=True,id=b71689fa-96c5-44a3-9305-2d3504cfc9a3,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71689fa-96')
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKiMIdlT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:36:31 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcf90fa-bcb3-49e5-acac-d0f7ba009403]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:36:31 user nova-compute[74882]: No targets found.
Nov 21 14:36:31 user nova-compute[74882]: iSNS:
Nov 21 14:36:31 user nova-compute[74882]: No targets found.
Nov 21 14:36:31 user nova-compute[74882]: STATIC:
Nov 21 14:36:31 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:36:31 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:36:31 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:36:31 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108
Nov 21 14:36:31 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:36:31 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:36:31 user nova-compute[74882]: FIRMWARE:
Nov 21 14:36:31 user nova-compute[74882]: No targets found.
Nov 21 14:36:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:36:31 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:36:31 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f749752e-88d4-4fa9-8487-11423d91fc39', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cfb014-210f-4a80-8f8d-8cf7db46d1b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697b91c-18fa-4b7e-8b54-7ff13dbf89eb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:31 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:31 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c446b90>, {}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Disconnecting from: [] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== disconnect_volume: return (70ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:36:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Deleting instance files /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a_del
Nov 21 14:36:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Deletion of /opt/stack/data/nova/instances/20630cb7-62c9-4e13-86a7-2432ed79368a_del complete
Nov 21 14:36:31 user nova-compute[74882]: INFO nova.compute.manager [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 21 14:36:31 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:36:31 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:36:32 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Took 0.77 seconds to deallocate network for instance.
Nov 21 14:36:32 user nova-compute[74882]: WARNING nova.volume.cinder [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Attachment bc5e922e-6ca5-49f1-ae9b-27c2c6c9960b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bc5e922e-6ca5-49f1-ae9b-27c2c6c9960b. (HTTP 404) (Request-ID: req-a69ad608-0281-4cb8-8472-c5b60f51a5bf)
Nov 21 14:36:32 user nova-compute[74882]: INFO nova.compute.manager [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Took 0.04 seconds to detach 1 volumes for instance.
Nov 21 14:36:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:32 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Deleted allocations for instance 20630cb7-62c9-4e13-86a7-2432ed79368a
Nov 21 14:36:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-9e48e0eb-827b-40fd-8cf9-b3296a8c7417 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Acquiring lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] Lock "20630cb7-62c9-4e13-86a7-2432ed79368a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] No waiting events found dispatching network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:36:32 user nova-compute[74882]: WARNING nova.compute.manager [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received unexpected event network-vif-plugged-b71689fa-96c5-44a3-9305-2d3504cfc9a3 for instance with vm_state deleted and task_state None.
Nov 21 14:36:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-0368d1f8-f3fb-4697-ad81-4101fd70321b req-5845ca7b-c8a2-4c7f-8f5f-dd0f7e377cac service nova] [instance: 20630cb7-62c9-4e13-86a7-2432ed79368a] Received event network-vif-deleted-b71689fa-96c5-44a3-9305-2d3504cfc9a3 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5/disk.rescue --force-share --output=json" returned: 0 in 0.364s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:41 user nova-compute[74882]: INFO nova.compute.manager [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Terminating instance
Nov 21 14:36:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-vif-unplugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] No waiting events found dispatching network-vif-unplugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-f0b09f08-2bec-4d53-95f1-b01cdf6e5c34 req-cba1f8e1-91cf-404a-985f-0164076c4200 service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-vif-unplugged-a2969955-0235-4311-83c4-3d30b0e2ac53 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Instance destroyed successfully.
Nov 21 14:36:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lazy-loading 'resources' on Instance uuid cdeb200f-cb4f-4916-8fef-b35ff231d033 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-30554362',display_name='tempest-ServerActionsTestOtherA-server-30554362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-30554362',id=4,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMaN0/9jGfW6ZjSbTp47CgZQSaJcY8icr0Fbu0U3apa991UWHZ2Qaf+nCcp9Afc2q1OCPVp0rryvMxAsgUnmI63Acxa+RyOWxYICLh9NHxR2dEBtviHUV9VoEyjNyOogQ==',key_name='tempest-keypair-367225751',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='079d8162d1ea42ddbf31668c8a44cf73',ramdisk_id='',reservation_id='r-yi860eg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-538546207',owner_user_name='tempest-ServerActionsTestOtherA-538546207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f06e22265f45beb3760ea3b9338c25',uuid=cdeb200f-cb4f-4916-8fef-b35ff231d033,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converting VIF {"id": "a2969955-0235-4311-83c4-3d30b0e2ac53", "address": "fa:16:3e:e4:b4:09", "network": {"id": "af07711f-e1bf-40bf-9cdc-f912efa55fcd", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1394306484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "079d8162d1ea42ddbf31668c8a44cf73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2969955-02", "ovs_interfaceid": "a2969955-0235-4311-83c4-3d30b0e2ac53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b4:09,bridge_name='br-int',has_traffic_filtering=True,id=a2969955-0235-4311-83c4-3d30b0e2ac53,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2969955-02') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG os_vif [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b4:09,bridge_name='br-int',has_traffic_filtering=True,id=a2969955-0235-4311-83c4-3d30b0e2ac53,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2969955-02') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2969955-02, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a1b93c7-a421-45c9-b334-93714fe59fc5) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:42 user nova-compute[74882]: INFO os_vif [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b4:09,bridge_name='br-int',has_traffic_filtering=True,id=a2969955-0235-4311-83c4-3d30b0e2ac53,network=Network(af07711f-e1bf-40bf-9cdc-f912efa55fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2969955-02')
Nov 21 14:36:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Deleting instance files /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033_del
Nov 21 14:36:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Deletion of /opt/stack/data/nova/instances/cdeb200f-cb4f-4916-8fef-b35ff231d033_del complete
Nov 21 14:36:42 user nova-compute[74882]: INFO nova.compute.manager [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-vif-deleted-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:43 user nova-compute[74882]: INFO nova.compute.manager [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Neutron deleted interface a2969955-0235-4311-83c4-3d30b0e2ac53; detaching it from the instance and deleting it from the info cache
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.network.neutron [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:36:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:36:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=25.06610870361328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:43 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Took 0.93 seconds to deallocate network for instance.
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-5f65b881-efcb-4bd3-b819-2fed22cefda7 req-1c447334-5446-41b1-9511-d2940e79cf0c service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Detach interface failed, port_id=a2969955-0235-4311-83c4-3d30b0e2ac53, reason: Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance cdeb200f-cb4f-4916-8fef-b35ff231d033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.332s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received event network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Acquiring lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] No waiting events found dispatching network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:36:43 user nova-compute[74882]: WARNING nova.compute.manager [req-5de881ff-2fd3-41e1-8275-a52cc02912d5 req-2e3ecde0-9ef1-44ad-a62a-23be57454e6f service nova] [instance: cdeb200f-cb4f-4916-8fef-b35ff231d033] Received unexpected event network-vif-plugged-a2969955-0235-4311-83c4-3d30b0e2ac53 for instance with vm_state deleted and task_state None.
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:36:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:43 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Deleted allocations for instance cdeb200f-cb4f-4916-8fef-b35ff231d033
Nov 21 14:36:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c1ba08e9-11c7-4235-8117-f139cc8ee8d2 tempest-ServerActionsTestOtherA-538546207 tempest-ServerActionsTestOtherA-538546207-project-member] Lock "cdeb200f-cb4f-4916-8fef-b35ff231d033" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:36:46 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:46 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:36:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:36:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:36:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:36:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:36:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Updating instance_info_cache with network_info: [{"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:36:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5a754e62-be65-4faa-a27c-0e4f3b02c842" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:36:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:36:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-changed-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Refreshing instance network info cache due to event network-changed-2173b2c8-e047-4709-ab98-0e5f6d077f8c. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Acquiring lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Acquired lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Refreshing network info cache for port 2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updated VIF entry in instance network info cache for port 2173b2c8-e047-4709-ab98-0e5f6d077f8c. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG nova.network.neutron [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updating instance_info_cache with network_info: [{"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-20c4b244-5513-4f29-bb50-9003375b0676 req-ad984397-2e03-4e2b-aff3-9c42d54be771 service nova] Releasing lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG nova.objects.instance [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'flavor' on Instance uuid 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:36:50 user nova-compute[74882]: INFO nova.compute.manager [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Attaching volume ebe16b16-d511-49f5-9111-c8387d694839 to /dev/vdb
Nov 21 14:36:50 user nova-compute[74882]: DEBUG os_brick.utils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1342165-864e-4d15-90a4-a70f90fadbb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470108d-12b6-47cc-bd2a-ecd843e87f20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8733ef72-9b29-4585-8e58-c92ea286da0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5e1cd-d472-4535-a468-c7cd3cc2ba62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:36:51 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:36:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[39da0bb4-a021-4781-946a-16f2563f3793]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG os_brick.utils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:36:51 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updating existing volume attachment record: ee2cc5a9-9c0b-4926-91ab-517342a5c04a {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:36:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moVILqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:36:56 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:36:56 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:36:56 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eca328-1bcd-4371-96c3-5d85ccab38d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:36:56 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0d3fa7-c850-466c-998e-67297a1d51f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839] added
Nov 21 14:36:56 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde24121-d6e6-48ff-8485-444dbd8486cf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[53415591-fbfd-4e78-af82-a8ed761eb973]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moVILqKY {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moVILqKY" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f94eb-999b-4df0-8116-f513cda5e717]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moVILqKY'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fae243-4535-4d37-8861-fbfeca8dd568]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b482c89e-2c76-45d6-bb64-1c48ea31b23b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:56 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:56 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:56 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:56 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:36:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef545f89-dc12-4870-9766-c7970c161bf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260]
Nov 21 14:36:57 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260] successful.
Nov 21 14:36:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e4f0a-4967-4bc0-8ff8-c8fe5686c5ba]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e7cbef-e878-4f02-a1e5-ccc203261b36]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:57 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:57 user nova-compute[74882]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 (non-flash)
Nov 21 14:36:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:36:57 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:36:57 user nova-compute[74882]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 (non-flash)
Nov 21 14:36:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d089d6e-fd3d-4457-8fdf-2264e805fb84]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moVILqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23939656231663836', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939656231663836', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG nova.objects.instance [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'flavor' on Instance uuid 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:36:58 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:36:58 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:36:58 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:36:58 user nova-compute[74882]:   <serial>ebe16b16-d511-49f5-9111-c8387d694839</serial>
Nov 21 14:36:58 user nova-compute[74882]: </disk>
Nov 21 14:36:58 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No VIF found with MAC fa:16:3e:ee:76:39, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:36:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-869826da-77f6-4ed9-92f7-4a004e32fcf3 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.785s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:01 user nova-compute[74882]: INFO nova.compute.manager [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Detaching volume ebe16b16-d511-49f5-9111-c8387d694839
Nov 21 14:37:01 user nova-compute[74882]: INFO nova.virt.block_device [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Attempting to driver detach volume ebe16b16-d511-49f5-9111-c8387d694839 from mountpoint /dev/vdb
Nov 21 14:37:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Attempting to detach device vdb from instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:37:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:37:01 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:37:01 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:37:01 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:37:01 user nova-compute[74882]:   <serial>ebe16b16-d511-49f5-9111-c8387d694839</serial>
Nov 21 14:37:01 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:37:01 user nova-compute[74882]: </disk>
Nov 21 14:37:01 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:37:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully detached device vdb from instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff from the persistent domain config.
Nov 21 14:37:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:37:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:37:01 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:37:01 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:37:01 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:37:01 user nova-compute[74882]:   <serial>ebe16b16-d511-49f5-9111-c8387d694839</serial>
Nov 21 14:37:01 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:37:01 user nova-compute[74882]: </disk>
Nov 21 14:37:01 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:37:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:37:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:37:13 user nova-compute[74882]: INFO nova.compute.claims [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Claim successful on node user
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:37:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.policy [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ad8112276648628ce9669c2445ea81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eea6fab008a747ef9093b7c92fb27708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:37:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Creating image(s)
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "/opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "/opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.165s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk 1073741824" returned: 0 in 0.049s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG nova.network.neutron [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Successfully created port: 35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Cannot resize image /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Ensure instance console log exists: /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Successfully updated port: 35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquired lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-changed-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Refreshing instance network info cache due to event network-changed-35832af2-de3b-476c-959f-c053228aa8b9. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Acquiring lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Updating instance_info_cache with network_info: [{"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Releasing lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Instance network_info: |[{"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Acquired lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.neutron [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Refreshing network info cache for port 35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Start _get_guest_xml network_info=[{"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:37:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1085701846',display_name='tempest-VolumesSnapshotTestJSON-instance-1085701846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1085701846',id=37,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH29VAkx9vv4ZlpeuG64I+mitrY1w90noGIG6MDOL1GQKBWXSJIUywZ+837obssmxZ7QBlOdeq9ll3dcdHy7cglp2/oFe6E8FeKZVn2m5A4+0qoRp/93rn0O9TP+toFw1g==',key_name='tempest-keypair-2025088500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea6fab008a747ef9093b7c92fb27708',ramdisk_id='',reservation_id='r-umx4l0av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985664337',owner_user_name='tempest-VolumesSnapshotTestJSON-1985664337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ad8112276648628ce9669c2445ea81',uuid=f8bb419d-8cfd-40fd-b570-70d6afb10cb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converting VIF {"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e2:06,bridge_name='br-int',has_traffic_filtering=True,id=35832af2-de3b-476c-959f-c053228aa8b9,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35832af2-de') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'pci_devices' on Instance uuid f8bb419d-8cfd-40fd-b570-70d6afb10cb3 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:37:15 user nova-compute[74882]:   <uuid>f8bb419d-8cfd-40fd-b570-70d6afb10cb3</uuid>
Nov 21 14:37:15 user nova-compute[74882]:   <name>instance-00000025</name>
Nov 21 14:37:15 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:37:15 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:37:15 user nova-compute[74882]:   <metadata>
Nov 21 14:37:15 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:37:15 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:37:15 user nova-compute[74882]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1085701846</nova:name>
Nov 21 14:37:15 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:37:15</nova:creationTime>
Nov 21 14:37:15 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:37:15 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:37:15 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:37:15 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:37:15 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:37:15 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:37:15 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:37:15 user nova-compute[74882]:       <nova:owner>
Nov 21 14:37:15 user nova-compute[74882]:         <nova:user uuid="d7ad8112276648628ce9669c2445ea81">tempest-VolumesSnapshotTestJSON-1985664337-project-member</nova:user>
Nov 21 14:37:15 user nova-compute[74882]:         <nova:project uuid="eea6fab008a747ef9093b7c92fb27708">tempest-VolumesSnapshotTestJSON-1985664337</nova:project>
Nov 21 14:37:15 user nova-compute[74882]:       </nova:owner>
Nov 21 14:37:15 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:37:15 user nova-compute[74882]:       <nova:ports>
Nov 21 14:37:15 user nova-compute[74882]:         <nova:port uuid="35832af2-de3b-476c-959f-c053228aa8b9">
Nov 21 14:37:15 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 21 14:37:15 user nova-compute[74882]:         </nova:port>
Nov 21 14:37:15 user nova-compute[74882]:       </nova:ports>
Nov 21 14:37:15 user nova-compute[74882]:     </nova:instance>
Nov 21 14:37:15 user nova-compute[74882]:   </metadata>
Nov 21 14:37:15 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:37:15 user nova-compute[74882]:     <system>
Nov 21 14:37:15 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:37:15 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:37:15 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:37:15 user nova-compute[74882]:       <entry name="serial">f8bb419d-8cfd-40fd-b570-70d6afb10cb3</entry>
Nov 21 14:37:15 user nova-compute[74882]:       <entry name="uuid">f8bb419d-8cfd-40fd-b570-70d6afb10cb3</entry>
Nov 21 14:37:15 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:37:15 user nova-compute[74882]:     </system>
Nov 21 14:37:15 user nova-compute[74882]:   </sysinfo>
Nov 21 14:37:15 user nova-compute[74882]:   <os>
Nov 21 14:37:15 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:37:15 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:37:15 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:37:15 user nova-compute[74882]:   </os>
Nov 21 14:37:15 user nova-compute[74882]:   <features>
Nov 21 14:37:15 user nova-compute[74882]:     <acpi/>
Nov 21 14:37:15 user nova-compute[74882]:     <apic/>
Nov 21 14:37:15 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:37:15 user nova-compute[74882]:   </features>
Nov 21 14:37:15 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:37:15 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:37:15 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:37:15 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:37:15 user nova-compute[74882]:   </clock>
Nov 21 14:37:15 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:37:15 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:37:15 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:37:15 user nova-compute[74882]:   </cpu>
Nov 21 14:37:15 user nova-compute[74882]:   <devices>
Nov 21 14:37:15 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:37:15 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:37:15 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk"/>
Nov 21 14:37:15 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:37:15 user nova-compute[74882]:     </disk>
Nov 21 14:37:15 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:37:15 user nova-compute[74882]:       <mac address="fa:16:3e:19:e2:06"/>
Nov 21 14:37:15 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:37:15 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:37:15 user nova-compute[74882]:       <target dev="tap35832af2-de"/>
Nov 21 14:37:15 user nova-compute[74882]:     </interface>
Nov 21 14:37:15 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:37:15 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/console.log" append="off"/>
Nov 21 14:37:15 user nova-compute[74882]:     </serial>
Nov 21 14:37:15 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:37:15 user nova-compute[74882]:     <video>
Nov 21 14:37:15 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:37:15 user nova-compute[74882]:     </video>
Nov 21 14:37:15 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:37:15 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:37:15 user nova-compute[74882]:     </rng>
Nov 21 14:37:15 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:37:15 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:37:15 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:37:15 user nova-compute[74882]:     </memballoon>
Nov 21 14:37:15 user nova-compute[74882]:   </devices>
Nov 21 14:37:15 user nova-compute[74882]: </domain>
Nov 21 14:37:15 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1085701846',display_name='tempest-VolumesSnapshotTestJSON-instance-1085701846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1085701846',id=37,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH29VAkx9vv4ZlpeuG64I+mitrY1w90noGIG6MDOL1GQKBWXSJIUywZ+837obssmxZ7QBlOdeq9ll3dcdHy7cglp2/oFe6E8FeKZVn2m5A4+0qoRp/93rn0O9TP+toFw1g==',key_name='tempest-keypair-2025088500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eea6fab008a747ef9093b7c92fb27708',ramdisk_id='',reservation_id='r-umx4l0av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1985664337',owner_user_name='tempest-VolumesSnapshotTestJSON-1985664337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ad8112276648628ce9669c2445ea81',uuid=f8bb419d-8cfd-40fd-b570-70d6afb10cb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converting VIF {"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e2:06,bridge_name='br-int',has_traffic_filtering=True,id=35832af2-de3b-476c-959f-c053228aa8b9,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35832af2-de') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG os_vif [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e2:06,bridge_name='br-int',has_traffic_filtering=True,id=35832af2-de3b-476c-959f-c053228aa8b9,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35832af2-de') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13767dcc-4df7-5c05-9c4c-9de56b232672', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35832af2-de, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35832af2-de, col_values=(('qos', UUID('7087b802-b5e5-4597-891b-badb1243b5d6')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35832af2-de, col_values=(('external_ids', {'iface-id': '35832af2-de3b-476c-959f-c053228aa8b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:e2:06', 'vm-uuid': 'f8bb419d-8cfd-40fd-b570-70d6afb10cb3'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:15 user nova-compute[74882]: INFO os_vif [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e2:06,bridge_name='br-int',has_traffic_filtering=True,id=35832af2-de3b-476c-959f-c053228aa8b9,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35832af2-de')
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No VIF found with MAC fa:16:3e:19:e2:06, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.neutron [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Updated VIF entry in instance network info cache for port 35832af2-de3b-476c-959f-c053228aa8b9. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG nova.network.neutron [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Updating instance_info_cache with network_info: [{"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:37:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0dbe0feb-c1d2-4293-968f-0a39ba920695 req-161e490a-8a4f-4738-8825-89628004c44a service nova] Releasing lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] No waiting events found dispatching network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:16 user nova-compute[74882]: WARNING nova.compute.manager [req-cb27a60c-770b-4f42-b38e-b01c8273901a req-792d0181-0f9f-46d6-b923-bd4c691865e7 service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received unexpected event network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 for instance with vm_state building and task_state spawning.
Nov 21 14:37:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:37:18 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Instance spawned successfully.
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] No waiting events found dispatching network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:19 user nova-compute[74882]: WARNING nova.compute.manager [req-918b96af-1be6-4e9f-857b-299b4331490b req-64372b8e-dea4-4c11-8e17-411772730d13 service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received unexpected event network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 for instance with vm_state building and task_state spawning.
Nov 21 14:37:19 user nova-compute[74882]: INFO nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 21 14:37:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:37:19 user nova-compute[74882]: INFO nova.compute.manager [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Took 5.90 seconds to build instance.
Nov 21 14:37:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-748a5be5-0f05-4ba2-8612-c9d0cfcf815f tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.986s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff is timed out.
Nov 21 14:37:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully detached device vdb from instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff from the live domain config.
Nov 21 14:37:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moVILqKY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:37:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ff842-3b3c-4340-896b-fd6aab836cdf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:37:21 user nova-compute[74882]: No targets found.
Nov 21 14:37:21 user nova-compute[74882]: iSNS:
Nov 21 14:37:21 user nova-compute[74882]: No targets found.
Nov 21 14:37:21 user nova-compute[74882]: STATIC:
Nov 21 14:37:21 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:37:21 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:37:21 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:37:21 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108
Nov 21 14:37:21 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:37:21 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:37:21 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839
Nov 21 14:37:21 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:37:21 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:37:21 user nova-compute[74882]: FIRMWARE:
Nov 21 14:37:21 user nova-compute[74882]: No targets found.
Nov 21 14:37:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:37:21 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:37:21 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c4bc0d-4c20-40c9-b971-63fba07bfe00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea65552e-40ff-458a-9d65-923bbcf010c2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:37:21 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:37:21 user nova-compute[74882]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 (non-flash)
Nov 21 14:37:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:37:21 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:37:21 user nova-compute[74882]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 (non-flash)
Nov 21 14:37:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c557370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f89c90-b245-4848-bcea-319dfda568ed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e37a8eb-978f-4c3f-b894-b062d3af955a]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcceb91-0bec-4bb4-810d-5621bba1bf03]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bffdb1-55d0-45d4-bfd5-44db5823581e]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd37282b-467c-46cb-8ccb-5a1fba8cba6c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:37:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e706950-4363-480d-bf2c-eca6738c4c6d]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260]
Nov 21 14:37:22 user nova-compute[74882]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839, portal: 172.16.0.220,3260] successful.
Nov 21 14:37:22 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebe16b16-d511-49f5-9111-c8387d694839 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7463c15b-8413-4575-97f4-e3c479b2a5dd]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] <== disconnect_volume: return (331ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG nova.objects.instance [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'flavor' on Instance uuid 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:37:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-19a34388-34ca-40d9-82ba-089f9a69a1ac tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.700s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:27 user nova-compute[74882]: INFO nova.compute.manager [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Unrescuing
Nov 21 14:37:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquired lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Updating instance_info_cache with network_info: [{"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Releasing lock "refresh_cache-6b4254b1-e8af-479c-9def-a84d4b0838f5" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'flavor' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:27 user nova-compute[74882]: WARNING nova.compute.manager [req-09c3d19e-231a-4685-8157-0210393920f3 req-f870bc72-a58b-4e43-bfb2-5ea341e60fbb service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:37:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance destroyed successfully.
Nov 21 14:37:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:29 user nova-compute[74882]: WARNING nova.compute.manager [req-bc157c23-a7da-4dab-9ff3-0a3b0724ce2c req-5f66661d-d999-4ad4-8200-0afb7d5c2caf service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:37:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-f828f58f-ef7d-40ec-9d48-eaefcfb79aaa tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:31 user nova-compute[74882]: WARNING nova.compute.manager [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state active and task_state None.
Nov 21 14:37:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:31 user nova-compute[74882]: WARNING nova.compute.manager [req-7e9b321d-2b9c-401f-8ec7-679f3a20d63f req-15cf4f65-a54c-4d4d-9a70-0cf5db5bb407 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state active and task_state None.
Nov 21 14:37:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:37:41 user nova-compute[74882]: INFO nova.compute.claims [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Claim successful on node user
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:37:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:37:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:37:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG nova.policy [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b8ebb88fee544a793fd71ebeee0845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c445b6ade47c09380da2248cf5954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:37:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Creating image(s)
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.211s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk 1073741824" returned: 0 in 0.055s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Cannot resize image /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Ensure instance console log exists: /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Successfully created port: 22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:44 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:44 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=25.063987731933594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Successfully updated port: 22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing instance network info cache due to event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.neutron [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance network_info: |[{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.neutron [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Start _get_guest_xml network_info=[{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:37:45 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:45 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377885678',display_name='tempest-ServerRescueNegativeTestJSON-server-377885678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377885678',id=38,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3EUcZV03Sh0eKhZjFWG/fQUZmRB6InEf01rFprKzRgYZVIElWC92bAAIdRNw1gr3K3D6aZwel0s/b2WDenRDNkeBJ3+JYjlJQkyF/m6ggGtSjbZh7XNvXlqBIjhS9WTw==',key_name='tempest-keypair-1647412110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5xqgzzg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=3c6eb2bb-d1c5-4c7e-940d-f8fda4278170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.objects.instance [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:37:45 user nova-compute[74882]:   <uuid>3c6eb2bb-d1c5-4c7e-940d-f8fda4278170</uuid>
Nov 21 14:37:45 user nova-compute[74882]:   <name>instance-00000026</name>
Nov 21 14:37:45 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:37:45 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:37:45 user nova-compute[74882]:   <metadata>
Nov 21 14:37:45 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:37:45 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:37:45 user nova-compute[74882]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-377885678</nova:name>
Nov 21 14:37:45 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:37:45</nova:creationTime>
Nov 21 14:37:45 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:37:45 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:37:45 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:37:45 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:37:45 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:37:45 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:37:45 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:37:45 user nova-compute[74882]:       <nova:owner>
Nov 21 14:37:45 user nova-compute[74882]:         <nova:user uuid="4b8ebb88fee544a793fd71ebeee0845f">tempest-ServerRescueNegativeTestJSON-2007417611-project-member</nova:user>
Nov 21 14:37:45 user nova-compute[74882]:         <nova:project uuid="e50c445b6ade47c09380da2248cf5954">tempest-ServerRescueNegativeTestJSON-2007417611</nova:project>
Nov 21 14:37:45 user nova-compute[74882]:       </nova:owner>
Nov 21 14:37:45 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:37:45 user nova-compute[74882]:       <nova:ports>
Nov 21 14:37:45 user nova-compute[74882]:         <nova:port uuid="22839d58-d656-40f7-8fe3-277e0e4d0c46">
Nov 21 14:37:45 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 14:37:45 user nova-compute[74882]:         </nova:port>
Nov 21 14:37:45 user nova-compute[74882]:       </nova:ports>
Nov 21 14:37:45 user nova-compute[74882]:     </nova:instance>
Nov 21 14:37:45 user nova-compute[74882]:   </metadata>
Nov 21 14:37:45 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:37:45 user nova-compute[74882]:     <system>
Nov 21 14:37:45 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:37:45 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:37:45 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:37:45 user nova-compute[74882]:       <entry name="serial">3c6eb2bb-d1c5-4c7e-940d-f8fda4278170</entry>
Nov 21 14:37:45 user nova-compute[74882]:       <entry name="uuid">3c6eb2bb-d1c5-4c7e-940d-f8fda4278170</entry>
Nov 21 14:37:45 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:37:45 user nova-compute[74882]:     </system>
Nov 21 14:37:45 user nova-compute[74882]:   </sysinfo>
Nov 21 14:37:45 user nova-compute[74882]:   <os>
Nov 21 14:37:45 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:37:45 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:37:45 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:37:45 user nova-compute[74882]:   </os>
Nov 21 14:37:45 user nova-compute[74882]:   <features>
Nov 21 14:37:45 user nova-compute[74882]:     <acpi/>
Nov 21 14:37:45 user nova-compute[74882]:     <apic/>
Nov 21 14:37:45 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:37:45 user nova-compute[74882]:   </features>
Nov 21 14:37:45 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:37:45 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:37:45 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:37:45 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:37:45 user nova-compute[74882]:   </clock>
Nov 21 14:37:45 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:37:45 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:37:45 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:37:45 user nova-compute[74882]:   </cpu>
Nov 21 14:37:45 user nova-compute[74882]:   <devices>
Nov 21 14:37:45 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:37:45 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:37:45 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk"/>
Nov 21 14:37:45 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:37:45 user nova-compute[74882]:     </disk>
Nov 21 14:37:45 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:37:45 user nova-compute[74882]:       <mac address="fa:16:3e:ce:2a:07"/>
Nov 21 14:37:45 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:37:45 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:37:45 user nova-compute[74882]:       <target dev="tap22839d58-d6"/>
Nov 21 14:37:45 user nova-compute[74882]:     </interface>
Nov 21 14:37:45 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:37:45 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/console.log" append="off"/>
Nov 21 14:37:45 user nova-compute[74882]:     </serial>
Nov 21 14:37:45 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:37:45 user nova-compute[74882]:     <video>
Nov 21 14:37:45 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:37:45 user nova-compute[74882]:     </video>
Nov 21 14:37:45 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:37:45 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:37:45 user nova-compute[74882]:     </rng>
Nov 21 14:37:45 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:37:45 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:37:45 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:37:45 user nova-compute[74882]:     </memballoon>
Nov 21 14:37:45 user nova-compute[74882]:   </devices>
Nov 21 14:37:45 user nova-compute[74882]: </domain>
Nov 21 14:37:45 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377885678',display_name='tempest-ServerRescueNegativeTestJSON-server-377885678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377885678',id=38,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3EUcZV03Sh0eKhZjFWG/fQUZmRB6InEf01rFprKzRgYZVIElWC92bAAIdRNw1gr3K3D6aZwel0s/b2WDenRDNkeBJ3+JYjlJQkyF/m6ggGtSjbZh7XNvXlqBIjhS9WTw==',key_name='tempest-keypair-1647412110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5xqgzzg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:37:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=3c6eb2bb-d1c5-4c7e-940d-f8fda4278170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG os_vif [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '097cc64e-8281-564c-98f4-ca1352acfc00', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22839d58-d6, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22839d58-d6, col_values=(('qos', UUID('95e68084-3df5-4cc2-b17d-c36465b05606')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22839d58-d6, col_values=(('external_ids', {'iface-id': '22839d58-d656-40f7-8fe3-277e0e4d0c46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:2a:07', 'vm-uuid': '3c6eb2bb-d1c5-4c7e-940d-f8fda4278170'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:45 user nova-compute[74882]: INFO os_vif [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6')
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No VIF found with MAC fa:16:3e:ce:2a:07, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.neutron [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updated VIF entry in instance network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:37:45 user nova-compute[74882]: DEBUG nova.network.neutron [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-efcd77d0-8af6-4d2b-8f37-e8539eab83f7 req-86624e9d-8669-49c5-bf7e-669a76a339b8 service nova] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:46 user nova-compute[74882]: WARNING nova.compute.manager [req-610f5a7c-d0fe-4996-a571-ef493956dba2 req-77d6220a-b765-4f38-8ef9-30627689ed51 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state building and task_state spawning.
Nov 21 14:37:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:37:47 user nova-compute[74882]: INFO nova.compute.claims [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Claim successful on node user
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:37:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:37:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.policy [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:37:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Creating image(s)
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.190s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk 1073741824" returned: 0 in 0.050s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Successfully created port: f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:37:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance spawned successfully.
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:49 user nova-compute[74882]: WARNING nova.compute.manager [req-1e74bd96-33fb-4f04-ba3f-d80efd73a49c req-b5dac3cf-bbce-4b99-b503-8ba1e830f689 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state building and task_state spawning.
Nov 21 14:37:49 user nova-compute[74882]: INFO nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Cannot resize image /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:49 user nova-compute[74882]: INFO nova.compute.manager [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Took 8.11 seconds to build instance.
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d689520d-0bf5-4478-a7a8-123700f3d0bd tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.225s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Successfully updated port: f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance network_info: |[{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Start _get_guest_xml network_info=[{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:37:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1853576747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1853576747',id=39,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNqwzkTWtb1hX9kGeFini4dr4Qww4cxq1yXUj1oAKofGkI6TECTCXonv6lH9zOXCj66y1aFuWoY9I0lVbQGymCq16jTqB4v1oS8eoj6yPpowy36aUXJmDbeRbcool7/A==',key_name='tempest-keypair-682860110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-lenihi0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=f968b9d7-44c3-42d4-8475-42bf7d3a1f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'pci_devices' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:37:49 user nova-compute[74882]:   <uuid>f968b9d7-44c3-42d4-8475-42bf7d3a1f9c</uuid>
Nov 21 14:37:49 user nova-compute[74882]:   <name>instance-00000027</name>
Nov 21 14:37:49 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:37:49 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:37:49 user nova-compute[74882]:   <metadata>
Nov 21 14:37:49 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:37:49 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:37:49 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1853576747</nova:name>
Nov 21 14:37:49 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:37:49</nova:creationTime>
Nov 21 14:37:49 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:37:49 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:37:49 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:37:49 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:37:49 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:37:49 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:37:49 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:37:49 user nova-compute[74882]:       <nova:owner>
Nov 21 14:37:49 user nova-compute[74882]:         <nova:user uuid="a0bd7642251d4e968bb108362dee3a3b">tempest-AttachVolumeShelveTestJSON-1109379350-project-member</nova:user>
Nov 21 14:37:49 user nova-compute[74882]:         <nova:project uuid="47eba7494a3b42929f2007ff8162d9bb">tempest-AttachVolumeShelveTestJSON-1109379350</nova:project>
Nov 21 14:37:49 user nova-compute[74882]:       </nova:owner>
Nov 21 14:37:49 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:37:49 user nova-compute[74882]:       <nova:ports>
Nov 21 14:37:49 user nova-compute[74882]:         <nova:port uuid="f04d9285-6760-4f9d-bfdf-e8187db846d5">
Nov 21 14:37:49 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 21 14:37:49 user nova-compute[74882]:         </nova:port>
Nov 21 14:37:49 user nova-compute[74882]:       </nova:ports>
Nov 21 14:37:49 user nova-compute[74882]:     </nova:instance>
Nov 21 14:37:49 user nova-compute[74882]:   </metadata>
Nov 21 14:37:49 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:37:49 user nova-compute[74882]:     <system>
Nov 21 14:37:49 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:37:49 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:37:49 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:37:49 user nova-compute[74882]:       <entry name="serial">f968b9d7-44c3-42d4-8475-42bf7d3a1f9c</entry>
Nov 21 14:37:49 user nova-compute[74882]:       <entry name="uuid">f968b9d7-44c3-42d4-8475-42bf7d3a1f9c</entry>
Nov 21 14:37:49 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:37:49 user nova-compute[74882]:     </system>
Nov 21 14:37:49 user nova-compute[74882]:   </sysinfo>
Nov 21 14:37:49 user nova-compute[74882]:   <os>
Nov 21 14:37:49 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:37:49 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:37:49 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:37:49 user nova-compute[74882]:   </os>
Nov 21 14:37:49 user nova-compute[74882]:   <features>
Nov 21 14:37:49 user nova-compute[74882]:     <acpi/>
Nov 21 14:37:49 user nova-compute[74882]:     <apic/>
Nov 21 14:37:49 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:37:49 user nova-compute[74882]:   </features>
Nov 21 14:37:49 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:37:49 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:37:49 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:37:49 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:37:49 user nova-compute[74882]:   </clock>
Nov 21 14:37:49 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:37:49 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:37:49 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:37:49 user nova-compute[74882]:   </cpu>
Nov 21 14:37:49 user nova-compute[74882]:   <devices>
Nov 21 14:37:49 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:37:49 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:37:49 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk"/>
Nov 21 14:37:49 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:37:49 user nova-compute[74882]:     </disk>
Nov 21 14:37:49 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:37:49 user nova-compute[74882]:       <mac address="fa:16:3e:a5:44:ea"/>
Nov 21 14:37:49 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:37:49 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:37:49 user nova-compute[74882]:       <target dev="tapf04d9285-67"/>
Nov 21 14:37:49 user nova-compute[74882]:     </interface>
Nov 21 14:37:49 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:37:49 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/console.log" append="off"/>
Nov 21 14:37:49 user nova-compute[74882]:     </serial>
Nov 21 14:37:49 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:37:49 user nova-compute[74882]:     <video>
Nov 21 14:37:49 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:37:49 user nova-compute[74882]:     </video>
Nov 21 14:37:49 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:37:49 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:37:49 user nova-compute[74882]:     </rng>
Nov 21 14:37:49 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:37:49 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:37:49 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:37:49 user nova-compute[74882]:     </memballoon>
Nov 21 14:37:49 user nova-compute[74882]:   </devices>
Nov 21 14:37:49 user nova-compute[74882]: </domain>
Nov 21 14:37:49 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1853576747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1853576747',id=39,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNqwzkTWtb1hX9kGeFini4dr4Qww4cxq1yXUj1oAKofGkI6TECTCXonv6lH9zOXCj66y1aFuWoY9I0lVbQGymCq16jTqB4v1oS8eoj6yPpowy36aUXJmDbeRbcool7/A==',key_name='tempest-keypair-682860110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-lenihi0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=f968b9d7-44c3-42d4-8475-42bf7d3a1f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG os_vif [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '282bb02b-a4ab-5a09-94f7-e67483ada540', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04d9285-67, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf04d9285-67, col_values=(('qos', UUID('fd2dbd92-d501-4d0b-a084-c5eef75685d8')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf04d9285-67, col_values=(('external_ids', {'iface-id': 'f04d9285-6760-4f9d-bfdf-e8187db846d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:44:ea', 'vm-uuid': 'f968b9d7-44c3-42d4-8475-42bf7d3a1f9c'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:37:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:49 user nova-compute[74882]: INFO os_vif [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67')
Nov 21 14:37:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:37:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No VIF found with MAC fa:16:3e:a5:44:ea, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing instance network info cache due to event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updated VIF entry in instance network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG nova.network.neutron [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3727e6a8-3d46-4de0-b6bd-5850191d552c req-bf5b4cc9-a8d5-41af-8b14-b5b0b2795881 service nova] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:53 user nova-compute[74882]: WARNING nova.compute.manager [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received unexpected event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with vm_state building and task_state spawning.
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:37:53 user nova-compute[74882]: WARNING nova.compute.manager [req-ded5d79f-eefb-4d9a-97df-12dcd1fbf8b6 req-83c1dd09-f599-4e3e-a320-53ef3e28de23 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received unexpected event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with vm_state building and task_state spawning.
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:37:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance spawned successfully.
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:37:53 user nova-compute[74882]: INFO nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 21 14:37:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:37:53 user nova-compute[74882]: INFO nova.compute.manager [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Took 6.30 seconds to build instance.
Nov 21 14:37:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e26299e9-fa90-4b63-a267-827c8630c329 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.405s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:37:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:37:55 user nova-compute[74882]: INFO nova.compute.manager [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] instance snapshotting
Nov 21 14:37:55 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Beginning live snapshot process
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.205s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi3_l6ywv/a400517d7194471dbedbaea324bf1941.delta 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:56 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi3_l6ywv/a400517d7194471dbedbaea324bf1941.delta 1073741824" returned: 0 in 0.076s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:56 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 21 14:37:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:37:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] COPY block job progress, current cursor: 131072 final cursor: 75563008 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:37:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] COPY block job progress, current cursor: 18874368 final cursor: 75563008 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:37:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:37:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 21 14:37:59 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:37:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi3_l6ywv/a400517d7194471dbedbaea324bf1941.delta /opt/stack/data/nova/instances/snapshots/tmpi3_l6ywv/a400517d7194471dbedbaea324bf1941 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:37:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi3_l6ywv/a400517d7194471dbedbaea324bf1941.delta /opt/stack/data/nova/instances/snapshots/tmpi3_l6ywv/a400517d7194471dbedbaea324bf1941" returned: 0 in 0.783s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:37:59 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Snapshot extracted, beginning image upload
Nov 21 14:37:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:02 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Snapshot image upload complete
Nov 21 14:38:02 user nova-compute[74882]: INFO nova.compute.manager [None req-a0bff61d-7f55-488f-af79-b46d2820c1a9 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Took 6.81 seconds to snapshot the instance on the hypervisor.
Nov 21 14:38:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:38:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:38:04 user nova-compute[74882]: INFO nova.compute.claims [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Claim successful on node user
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:38:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.policy [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eafb1966d06e4d688566d1b5af779c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce558a840a8c4055a42b197328a0d13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:38:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Creating image(s)
Nov 21 14:38:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "/opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "/opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "/opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "2d0d4c13b040cef402b5c37a4954edb4c6b017e4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "2d0d4c13b040cef402b5c37a4954edb4c6b017e4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG nova.virt.images [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 3f571ea2-6206-4ad2-b9fe-0a6c5862686a was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.part /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:38:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:07 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:38:07 user nova-compute[74882]: INFO nova.compute.claims [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Claim successful on node user
Nov 21 14:38:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:07 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Successfully created port: 1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.part /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.converted" returned: 0 in 1.273s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "2d0d4c13b040cef402b5c37a4954edb4c6b017e4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.588s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.967s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:38:08 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 --force-share --output=json" returned: 0 in 0.203s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "2d0d4c13b040cef402b5c37a4954edb4c6b017e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "2d0d4c13b040cef402b5c37a4954edb4c6b017e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.policy [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be4482694f814db8bd913d090863c1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c6598be22e24ce3801f37d80c2b7c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4,backing_fmt=raw /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:38:08 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Creating image(s)
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "/opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "/opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4,backing_fmt=raw /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk 1073741824" returned: 0 in 0.107s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "2d0d4c13b040cef402b5c37a4954edb4c6b017e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Successfully updated port: 1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-changed-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Refreshing instance network info cache due to event network-changed-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Acquiring lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Acquired lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.network.neutron [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Refreshing network info cache for port 1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.network.neutron [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.209s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Ensure instance console log exists: /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-421d33d8-2c2c-4b7d-969c-40d8eae37397 req-ec867718-1f56-470d-8778-969d3eff0f4c service nova] Releasing lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquired lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk 1073741824" returned: 0 in 0.052s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Successfully created port: 59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updating instance_info_cache with network_info: [{"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Releasing lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Instance network_info: |[{"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Start _get_guest_xml network_info=[{"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='312fa8784e81afe225e4855dd185662f',container_format='bare',created_at=2023-11-21T14:37:56Z,direct_url=<?>,disk_format='qcow2',id=3f571ea2-6206-4ad2-b9fe-0a6c5862686a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1689916378',owner='ce558a840a8c4055a42b197328a0d13a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-21T14:38:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '3f571ea2-6206-4ad2-b9fe-0a6c5862686a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:38:09 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:38:09 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='312fa8784e81afe225e4855dd185662f',container_format='bare',created_at=2023-11-21T14:37:56Z,direct_url=<?>,disk_format='qcow2',id=3f571ea2-6206-4ad2-b9fe-0a6c5862686a,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1689916378',owner='ce558a840a8c4055a42b197328a0d13a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-21T14:38:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1746098191',display_name='tempest-TestStampPattern-server-1746098191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1746098191',id=40,image_ref='3f571ea2-6206-4ad2-b9fe-0a6c5862686a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH5NG9mjIsga52s0kRKH9IrZe7eb8u0uHJimILwFq6gc6XeS9P2KhDI3bZMrALH0JW9EBkiPZJdps54hxAky6TAI2RrDSglRCp0u6RTSK0kGXjhWDxXPScCdj6QO4CfoQ==',key_name='tempest-TestStampPattern-124603786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce558a840a8c4055a42b197328a0d13a',ramdisk_id='',reservation_id='r-889aq2a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff',image_min_disk='1',image_min_ram='0',image_owner_id='ce558a840a8c4055a42b197328a0d13a',image_owner_project_name='tempest-TestStampPattern-1219016270',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1219016270-project-member',image_user_id='eafb1966d06e4d688566d1b5af779c17',network_allocated='True',owner_project_name='tempest-TestStampPattern-1219016270',owner_user_name='tempest-TestStampPattern-1219016270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:38:06Z,user_data=None,user_id='eafb1966d06e4d688566d1b5af779c17',uuid=7842f8c8-ffe8-4944-afad-61c4a2bc017a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converting VIF {"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8d:38,bridge_name='br-int',has_traffic_filtering=True,id=1722ec5a-005b-4f1c-aa1c-d2182bb27c0e,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1722ec5a-00') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'pci_devices' on Instance uuid 7842f8c8-ffe8-4944-afad-61c4a2bc017a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Cannot resize image /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Ensure instance console log exists: /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:38:09 user nova-compute[74882]:   <uuid>7842f8c8-ffe8-4944-afad-61c4a2bc017a</uuid>
Nov 21 14:38:09 user nova-compute[74882]:   <name>instance-00000028</name>
Nov 21 14:38:09 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:38:09 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:38:09 user nova-compute[74882]:   <metadata>
Nov 21 14:38:09 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:38:09 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:38:09 user nova-compute[74882]:       <nova:name>tempest-TestStampPattern-server-1746098191</nova:name>
Nov 21 14:38:09 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:38:09</nova:creationTime>
Nov 21 14:38:09 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:38:09 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:38:09 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:38:09 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:38:09 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:38:09 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:38:09 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:38:09 user nova-compute[74882]:       <nova:owner>
Nov 21 14:38:09 user nova-compute[74882]:         <nova:user uuid="eafb1966d06e4d688566d1b5af779c17">tempest-TestStampPattern-1219016270-project-member</nova:user>
Nov 21 14:38:09 user nova-compute[74882]:         <nova:project uuid="ce558a840a8c4055a42b197328a0d13a">tempest-TestStampPattern-1219016270</nova:project>
Nov 21 14:38:09 user nova-compute[74882]:       </nova:owner>
Nov 21 14:38:09 user nova-compute[74882]:       <nova:root type="image" uuid="3f571ea2-6206-4ad2-b9fe-0a6c5862686a"/>
Nov 21 14:38:09 user nova-compute[74882]:       <nova:ports>
Nov 21 14:38:09 user nova-compute[74882]:         <nova:port uuid="1722ec5a-005b-4f1c-aa1c-d2182bb27c0e">
Nov 21 14:38:09 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 21 14:38:09 user nova-compute[74882]:         </nova:port>
Nov 21 14:38:09 user nova-compute[74882]:       </nova:ports>
Nov 21 14:38:09 user nova-compute[74882]:     </nova:instance>
Nov 21 14:38:09 user nova-compute[74882]:   </metadata>
Nov 21 14:38:09 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:38:09 user nova-compute[74882]:     <system>
Nov 21 14:38:09 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:38:09 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:38:09 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:38:09 user nova-compute[74882]:       <entry name="serial">7842f8c8-ffe8-4944-afad-61c4a2bc017a</entry>
Nov 21 14:38:09 user nova-compute[74882]:       <entry name="uuid">7842f8c8-ffe8-4944-afad-61c4a2bc017a</entry>
Nov 21 14:38:09 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:38:09 user nova-compute[74882]:     </system>
Nov 21 14:38:09 user nova-compute[74882]:   </sysinfo>
Nov 21 14:38:09 user nova-compute[74882]:   <os>
Nov 21 14:38:09 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:38:09 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:38:09 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:38:09 user nova-compute[74882]:   </os>
Nov 21 14:38:09 user nova-compute[74882]:   <features>
Nov 21 14:38:09 user nova-compute[74882]:     <acpi/>
Nov 21 14:38:09 user nova-compute[74882]:     <apic/>
Nov 21 14:38:09 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:38:09 user nova-compute[74882]:   </features>
Nov 21 14:38:09 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:38:09 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:38:09 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:38:09 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:38:09 user nova-compute[74882]:   </clock>
Nov 21 14:38:09 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:38:09 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:38:09 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:38:09 user nova-compute[74882]:   </cpu>
Nov 21 14:38:09 user nova-compute[74882]:   <devices>
Nov 21 14:38:09 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:38:09 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:38:09 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk"/>
Nov 21 14:38:09 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:38:09 user nova-compute[74882]:     </disk>
Nov 21 14:38:09 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:38:09 user nova-compute[74882]:       <mac address="fa:16:3e:fb:8d:38"/>
Nov 21 14:38:09 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:38:09 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:38:09 user nova-compute[74882]:       <target dev="tap1722ec5a-00"/>
Nov 21 14:38:09 user nova-compute[74882]:     </interface>
Nov 21 14:38:09 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:38:09 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/console.log" append="off"/>
Nov 21 14:38:09 user nova-compute[74882]:     </serial>
Nov 21 14:38:09 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:38:09 user nova-compute[74882]:     <video>
Nov 21 14:38:09 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:38:09 user nova-compute[74882]:     </video>
Nov 21 14:38:09 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:38:09 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:38:09 user nova-compute[74882]:     </rng>
Nov 21 14:38:09 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:38:09 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:38:09 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:38:09 user nova-compute[74882]:     </memballoon>
Nov 21 14:38:09 user nova-compute[74882]:   </devices>
Nov 21 14:38:09 user nova-compute[74882]: </domain>
Nov 21 14:38:09 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1746098191',display_name='tempest-TestStampPattern-server-1746098191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1746098191',id=40,image_ref='3f571ea2-6206-4ad2-b9fe-0a6c5862686a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH5NG9mjIsga52s0kRKH9IrZe7eb8u0uHJimILwFq6gc6XeS9P2KhDI3bZMrALH0JW9EBkiPZJdps54hxAky6TAI2RrDSglRCp0u6RTSK0kGXjhWDxXPScCdj6QO4CfoQ==',key_name='tempest-TestStampPattern-124603786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce558a840a8c4055a42b197328a0d13a',ramdisk_id='',reservation_id='r-889aq2a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff',image_min_disk='1',image_min_ram='0',image_owner_id='ce558a840a8c4055a42b197328a0d13a',image_owner_project_name='tempest-TestStampPattern-1219016270',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1219016270-project-member',image_user_id='eafb1966d06e4d688566d1b5af779c17',network_allocated='True',owner_project_name='tempest-TestStampPattern-1219016270',owner_user_name='tempest-TestStampPattern-1219016270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:38:06Z,user_data=None,user_id='eafb1966d06e4d688566d1b5af779c17',uuid=7842f8c8-ffe8-4944-afad-61c4a2bc017a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converting VIF {"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8d:38,bridge_name='br-int',has_traffic_filtering=True,id=1722ec5a-005b-4f1c-aa1c-d2182bb27c0e,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1722ec5a-00') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG os_vif [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8d:38,bridge_name='br-int',has_traffic_filtering=True,id=1722ec5a-005b-4f1c-aa1c-d2182bb27c0e,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1722ec5a-00') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0deba711-a0f4-56ae-9afc-5fdf0463ce44', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1722ec5a-00, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1722ec5a-00, col_values=(('qos', UUID('3ab76fab-6816-484e-9f12-28bf69fdda5b')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1722ec5a-00, col_values=(('external_ids', {'iface-id': '1722ec5a-005b-4f1c-aa1c-d2182bb27c0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:8d:38', 'vm-uuid': '7842f8c8-ffe8-4944-afad-61c4a2bc017a'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:09 user nova-compute[74882]: INFO os_vif [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:8d:38,bridge_name='br-int',has_traffic_filtering=True,id=1722ec5a-005b-4f1c-aa1c-d2182bb27c0e,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1722ec5a-00')
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:38:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No VIF found with MAC fa:16:3e:fb:8d:38, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Successfully updated port: 59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquired lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-changed-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Refreshing instance network info cache due to event network-changed-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Acquiring lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Updating instance_info_cache with network_info: [{"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Releasing lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Instance network_info: |[{"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Acquired lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Refreshing network info cache for port 59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Start _get_guest_xml network_info=[{"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:38:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:38:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:38:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3333109',id=41,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PaMj3KH/QGatcwq0x+nUcN5bBnhHMcFTnS+cH5MeUvdSTZmhPdcZHh+E3loIVrYH1ccXRsi/n46ZW3DCpKPbS0mAMWfCIKqFtKhkvvQyrfqUz4nX8XYs13PYioP8weA==',key_name='tempest-keypair-1230849473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c6598be22e24ce3801f37d80c2b7c51',ramdisk_id='',reservation_id='r-4ugc3n68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1834514172',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:38:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be4482694f814db8bd913d090863c1e5',uuid=e5c578a4-87f5-4c67-af63-c9ac43b64ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Converting VIF {"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:7e,bridge_name='br-int',has_traffic_filtering=True,id=59b81b61-a9e0-4a60-853e-9f1a43a0ef2a,network=Network(f8a78092-9e30-4479-a70f-0ef5046d7d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b81b61-a9') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.objects.instance [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lazy-loading 'pci_devices' on Instance uuid e5c578a4-87f5-4c67-af63-c9ac43b64ddf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:38:10 user nova-compute[74882]:   <uuid>e5c578a4-87f5-4c67-af63-c9ac43b64ddf</uuid>
Nov 21 14:38:10 user nova-compute[74882]:   <name>instance-00000029</name>
Nov 21 14:38:10 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:38:10 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:38:10 user nova-compute[74882]:   <metadata>
Nov 21 14:38:10 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:38:10 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:38:10 user nova-compute[74882]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994</nova:name>
Nov 21 14:38:10 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:38:10</nova:creationTime>
Nov 21 14:38:10 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:38:10 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:38:10 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:38:10 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:38:10 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:38:10 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:38:10 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:38:10 user nova-compute[74882]:       <nova:owner>
Nov 21 14:38:10 user nova-compute[74882]:         <nova:user uuid="be4482694f814db8bd913d090863c1e5">tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member</nova:user>
Nov 21 14:38:10 user nova-compute[74882]:         <nova:project uuid="9c6598be22e24ce3801f37d80c2b7c51">tempest-TestServerVolumeAttachScenarioOldVersion-1834514172</nova:project>
Nov 21 14:38:10 user nova-compute[74882]:       </nova:owner>
Nov 21 14:38:10 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:38:10 user nova-compute[74882]:       <nova:ports>
Nov 21 14:38:10 user nova-compute[74882]:         <nova:port uuid="59b81b61-a9e0-4a60-853e-9f1a43a0ef2a">
Nov 21 14:38:10 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 14:38:10 user nova-compute[74882]:         </nova:port>
Nov 21 14:38:10 user nova-compute[74882]:       </nova:ports>
Nov 21 14:38:10 user nova-compute[74882]:     </nova:instance>
Nov 21 14:38:10 user nova-compute[74882]:   </metadata>
Nov 21 14:38:10 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:38:10 user nova-compute[74882]:     <system>
Nov 21 14:38:10 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:38:10 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:38:10 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:38:10 user nova-compute[74882]:       <entry name="serial">e5c578a4-87f5-4c67-af63-c9ac43b64ddf</entry>
Nov 21 14:38:10 user nova-compute[74882]:       <entry name="uuid">e5c578a4-87f5-4c67-af63-c9ac43b64ddf</entry>
Nov 21 14:38:10 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:38:10 user nova-compute[74882]:     </system>
Nov 21 14:38:10 user nova-compute[74882]:   </sysinfo>
Nov 21 14:38:10 user nova-compute[74882]:   <os>
Nov 21 14:38:10 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:38:10 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:38:10 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:38:10 user nova-compute[74882]:   </os>
Nov 21 14:38:10 user nova-compute[74882]:   <features>
Nov 21 14:38:10 user nova-compute[74882]:     <acpi/>
Nov 21 14:38:10 user nova-compute[74882]:     <apic/>
Nov 21 14:38:10 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:38:10 user nova-compute[74882]:   </features>
Nov 21 14:38:10 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:38:10 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:38:10 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:38:10 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:38:10 user nova-compute[74882]:   </clock>
Nov 21 14:38:10 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:38:10 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:38:10 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:38:10 user nova-compute[74882]:   </cpu>
Nov 21 14:38:10 user nova-compute[74882]:   <devices>
Nov 21 14:38:10 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:38:10 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:38:10 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk"/>
Nov 21 14:38:10 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:38:10 user nova-compute[74882]:     </disk>
Nov 21 14:38:10 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:38:10 user nova-compute[74882]:       <mac address="fa:16:3e:27:55:7e"/>
Nov 21 14:38:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:38:10 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:38:10 user nova-compute[74882]:       <target dev="tap59b81b61-a9"/>
Nov 21 14:38:10 user nova-compute[74882]:     </interface>
Nov 21 14:38:10 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:38:10 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/console.log" append="off"/>
Nov 21 14:38:10 user nova-compute[74882]:     </serial>
Nov 21 14:38:10 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:38:10 user nova-compute[74882]:     <video>
Nov 21 14:38:10 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:38:10 user nova-compute[74882]:     </video>
Nov 21 14:38:10 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:38:10 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:38:10 user nova-compute[74882]:     </rng>
Nov 21 14:38:10 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:38:10 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:38:10 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:38:10 user nova-compute[74882]:     </memballoon>
Nov 21 14:38:10 user nova-compute[74882]:   </devices>
Nov 21 14:38:10 user nova-compute[74882]: </domain>
Nov 21 14:38:10 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:38:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3333109',id=41,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PaMj3KH/QGatcwq0x+nUcN5bBnhHMcFTnS+cH5MeUvdSTZmhPdcZHh+E3loIVrYH1ccXRsi/n46ZW3DCpKPbS0mAMWfCIKqFtKhkvvQyrfqUz4nX8XYs13PYioP8weA==',key_name='tempest-keypair-1230849473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c6598be22e24ce3801f37d80c2b7c51',ramdisk_id='',reservation_id='r-4ugc3n68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1834514172',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:38:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be4482694f814db8bd913d090863c1e5',uuid=e5c578a4-87f5-4c67-af63-c9ac43b64ddf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Converting VIF {"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:7e,bridge_name='br-int',has_traffic_filtering=True,id=59b81b61-a9e0-4a60-853e-9f1a43a0ef2a,network=Network(f8a78092-9e30-4479-a70f-0ef5046d7d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b81b61-a9') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG os_vif [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:7e,bridge_name='br-int',has_traffic_filtering=True,id=59b81b61-a9e0-4a60-853e-9f1a43a0ef2a,network=Network(f8a78092-9e30-4479-a70f-0ef5046d7d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b81b61-a9') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eb46783-c57c-5af0-a574-badd9cb7727b', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59b81b61-a9, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59b81b61-a9, col_values=(('qos', UUID('174089ef-ffa2-4fc3-b835-bc53358b4822')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59b81b61-a9, col_values=(('external_ids', {'iface-id': '59b81b61-a9e0-4a60-853e-9f1a43a0ef2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:55:7e', 'vm-uuid': 'e5c578a4-87f5-4c67-af63-c9ac43b64ddf'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: INFO os_vif [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:7e,bridge_name='br-int',has_traffic_filtering=True,id=59b81b61-a9e0-4a60-853e-9f1a43a0ef2a,network=Network(f8a78092-9e30-4479-a70f-0ef5046d7d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b81b61-a9')
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] No VIF found with MAC fa:16:3e:27:55:7e, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Updated VIF entry in instance network info cache for port 59b81b61-a9e0-4a60-853e-9f1a43a0ef2a. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG nova.network.neutron [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Updating instance_info_cache with network_info: [{"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ff07028f-0e1c-4479-9e46-e6191f29a7c8 req-95617106-b0d4-4f6a-8b8d-a98994d50860 service nova] Releasing lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:38:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] No waiting events found dispatching network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:38:11 user nova-compute[74882]: WARNING nova.compute.manager [req-17c55d31-fce2-4850-9291-4d18215e798f req-948276b2-b7b7-4792-89dd-5b5abf0cfdc3 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received unexpected event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance with vm_state building and task_state spawning.
Nov 21 14:38:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] No waiting events found dispatching network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:38:12 user nova-compute[74882]: WARNING nova.compute.manager [req-747999c0-5b4e-4fd2-b215-826d245fdf75 req-72b4215f-f5c5-47fc-b66c-08823b92522c service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received unexpected event network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance with vm_state building and task_state spawning.
Nov 21 14:38:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:38:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] No waiting events found dispatching network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:38:13 user nova-compute[74882]: WARNING nova.compute.manager [req-4f5eb655-4589-4975-882c-c2c61e2491f1 req-a05d8bf4-77bb-40db-8abb-53b3680eefcc service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received unexpected event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance with vm_state building and task_state spawning.
Nov 21 14:38:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:38:14 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Instance spawned successfully.
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:14 user nova-compute[74882]: INFO nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Took 9.19 seconds to spawn the instance on the hypervisor.
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] No waiting events found dispatching network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:38:14 user nova-compute[74882]: WARNING nova.compute.manager [req-24602ec5-e952-4ac2-ab05-7f4cc29ddc71 req-d93559e1-674f-4caa-8440-23adac8919da service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received unexpected event network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance with vm_state building and task_state spawning.
Nov 21 14:38:14 user nova-compute[74882]: INFO nova.compute.manager [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Took 10.01 seconds to build instance.
Nov 21 14:38:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1b81793a-d243-4bbb-9135-c78e8e77beb0 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.105s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:38:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Instance spawned successfully.
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:38:15 user nova-compute[74882]: INFO nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 21 14:38:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:38:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:15 user nova-compute[74882]: INFO nova.compute.manager [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Took 8.34 seconds to build instance.
Nov 21 14:38:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-488c3bc2-cd30-4432-81b2-87ff8a518dda tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.817s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:38:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:38:46 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:38:46 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7393MB free_disk=24.82030487060547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 6b4254b1-e8af-479c-9def-a84d4b0838f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:38:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:38:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:38:48 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updating instance_info_cache with network_info: [{"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:38:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:38:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:38:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:38:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:38:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:38:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-changed-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Refreshing instance network info cache due to event network-changed-35832af2-de3b-476c-959f-c053228aa8b9. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Acquiring lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Acquired lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Refreshing network info cache for port 35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'flavor' on Instance uuid f8bb419d-8cfd-40fd-b570-70d6afb10cb3 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Ignoring supplied device name: /dev/vdb
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:04 user nova-compute[74882]: INFO nova.compute.manager [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Attaching volume 9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 to /dev/vdb
Nov 21 14:39:04 user nova-compute[74882]: DEBUG os_brick.utils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ace9df-ccf1-4667-b69d-8bcf6af6713b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[47859fc8-7487-490a-93bf-b289596be8dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG nova.network.neutron [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Updated VIF entry in instance network info cache for port 35832af2-de3b-476c-959f-c053228aa8b9. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG nova.network.neutron [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Updating instance_info_cache with network_info: [{"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e527d59-33e0-4f0c-98a9-4bdab782e1f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdccf2e-1936-4eca-9c9d-e0af39824f85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-58a408aa-d834-43ae-bde1-b4d6da743656 req-76f1d7cf-2be8-4e79-9ce4-e6ff424cda1a service nova] Releasing lock "refresh_cache-f8bb419d-8cfd-40fd-b570-70d6afb10cb3" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:39:05 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:39:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[854f3439-0835-4831-a79e-c1454593e7b9]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG os_brick.utils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Updating existing volume attachment record: 4d45ed61-54e7-4fae-9fbd-646ff3fbcd74 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:39:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdTilkVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:10 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:39:10 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:39:10 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6771e854-390b-4bf8-8250-10a40a8ee2ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:39:10 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00cd9b9-e6e1-4387-8fd0-38c8b24fe0c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0] added
Nov 21 14:39:10 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19227e4-65fb-4be5-924f-fe35b5b9e2a0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28d3be4-85df-4b6a-956a-b7ea3bf0e01b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdTilkVa {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdTilkVa" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b8840d-0cdd-4e1f-88fd-19dad5da9a6f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PdTilkVa'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d10a191-56d8-4f72-a1d5-731489965001]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140bab2-79f6-4392-b270-7e43cac1dd5b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:10 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:39:10 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:10 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:39:10 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:39:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af34fb-b979-48fc-9104-c6660df9899e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260]
Nov 21 14:39:11 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260] successful.
Nov 21 14:39:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6824d67-aad0-4eaa-aa86-dad1d87dcb7f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f022f-34cf-40e8-ad88-2c6b46309a76]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:11 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:39:11 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:11 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:39:11 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b483b-1bd8-4dfe-934c-2dbddbcb7ead]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdTilkVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23936616466323936', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936616466323936', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'flavor' on Instance uuid f8bb419d-8cfd-40fd-b570-70d6afb10cb3 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:39:12 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:39:12 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:39:12 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:39:12 user nova-compute[74882]:   <serial>9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0</serial>
Nov 21 14:39:12 user nova-compute[74882]: </disk>
Nov 21 14:39:12 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] No VIF found with MAC fa:16:3e:19:e2:06, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f32c5187-8cf7-4f7d-869f-0b7b3c6f1697 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.830s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:18 user nova-compute[74882]: INFO nova.compute.manager [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Terminating instance
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-9740ab09-efab-4966-8ff1-ddb111211488 req-3189d411-6ab1-4985-a890-e16999271033 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-unplugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Instance destroyed successfully.
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.objects.instance [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'resources' on Instance uuid 6b4254b1-e8af-479c-9def-a84d4b0838f5 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1731130822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1731130822',id=33,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:35:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-qrccy6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:37:32Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=6b4254b1-e8af-479c-9def-a84d4b0838f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "d01918fa-7533-4b43-95ca-1baa184edfdc", "address": "fa:16:3e:ac:55:32", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01918fa-75", "ovs_interfaceid": "d01918fa-7533-4b43-95ca-1baa184edfdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG os_vif [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd01918fa-75, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ff5b5c4-44ff-439c-b517-d4a37bac51f0) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:18 user nova-compute[74882]: INFO os_vif [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=d01918fa-7533-4b43-95ca-1baa184edfdc,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01918fa-75')
Nov 21 14:39:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPwQxedW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:18 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:39:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a06457-26ae-44b8-b371-60353e7ecab2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:39:18 user nova-compute[74882]: No targets found.
Nov 21 14:39:18 user nova-compute[74882]: iSNS:
Nov 21 14:39:18 user nova-compute[74882]: No targets found.
Nov 21 14:39:18 user nova-compute[74882]: STATIC:
Nov 21 14:39:18 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:39:18 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:18 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:18 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0
Nov 21 14:39:18 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:18 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:18 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108
Nov 21 14:39:18 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:18 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:18 user nova-compute[74882]: FIRMWARE:
Nov 21 14:39:18 user nova-compute[74882]: No targets found.
Nov 21 14:39:18 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:39:18 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:39:18 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcbfda5-be15-419a-8a1f-b4ed04f55ff3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f34836-4ee1-4c6d-b599-f975651a70d4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:19 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:39:19 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:19 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:19 user nova-compute[74882]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 (non-flash)
Nov 21 14:39:19 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:19 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c64b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a186a3-45ee-495e-858e-89fcccb08c51]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae215d6-ee90-4d0a-9f46-67bcfd0bc7b4]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3279147-522f-422a-9660-3fef8f173825]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecfe04d-3cb3-457b-a579-093e5ee958e3]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b4ea34-63ee-464e-8727-3412113594f1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8513fb-9b01-4e07-a12a-9a833955182c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260]
Nov 21 14:39:19 user nova-compute[74882]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108, portal: 172.16.0.220,3260] successful.
Nov 21 14:39:19 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ecbc30-dd7c-4ae7-a23e-d3f4db85c108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc44e8e-550f-4542-9bcc-b9caa7cb5512]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== disconnect_volume: return (305ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:39:19 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Deleting instance files /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5_del
Nov 21 14:39:19 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Deletion of /opt/stack/data/nova/instances/6b4254b1-e8af-479c-9def-a84d4b0838f5_del complete
Nov 21 14:39:19 user nova-compute[74882]: INFO nova.compute.manager [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 21 14:39:19 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:39:19 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:19 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Took 0.42 seconds to deallocate network for instance.
Nov 21 14:39:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-5ce31a94-dc0d-4e96-a2e8-13110adbffc1 req-11d0fe62-e48e-4367-a2fd-669dfd0210c5 service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-deleted-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Acquiring lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] No waiting events found dispatching network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:20 user nova-compute[74882]: WARNING nova.compute.manager [req-44f8f517-2b5b-4cfc-8c56-47ea9085843a req-07b6302b-2eda-4fa0-bf16-24972e22f34d service nova] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Received unexpected event network-vif-plugged-d01918fa-7533-4b43-95ca-1baa184edfdc for instance with vm_state active and task_state deleting.
Nov 21 14:39:20 user nova-compute[74882]: INFO nova.compute.manager [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 6b4254b1-e8af-479c-9def-a84d4b0838f5] Took 0.77 seconds to detach 1 volumes for instance.
Nov 21 14:39:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:39:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:20 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Deleted allocations for instance 6b4254b1-e8af-479c-9def-a84d4b0838f5
Nov 21 14:39:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14b43b70-e104-4d64-8148-2d5b99ed99fc tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "6b4254b1-e8af-479c-9def-a84d4b0838f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.883s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:28 user nova-compute[74882]: INFO nova.compute.manager [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Detaching volume 9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0
Nov 21 14:39:29 user nova-compute[74882]: INFO nova.virt.block_device [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Attempting to driver detach volume 9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 from mountpoint /dev/vdb
Nov 21 14:39:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Attempting to detach device vdb from instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:39:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:39:29 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:39:29 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:39:29 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:39:29 user nova-compute[74882]:   <serial>9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0</serial>
Nov 21 14:39:29 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:39:29 user nova-compute[74882]: </disk>
Nov 21 14:39:29 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:39:29 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully detached device vdb from instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 from the persistent domain config.
Nov 21 14:39:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:39:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:39:29 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:39:29 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:39:29 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:39:29 user nova-compute[74882]:   <serial>9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0</serial>
Nov 21 14:39:29 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:39:29 user nova-compute[74882]: </disk>
Nov 21 14:39:29 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:39:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:39:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing instance network info cache due to event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:39:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:32 user nova-compute[74882]: INFO nova.compute.manager [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Attaching volume 726f2986-4d69-45b4-b2d6-89adc9c3c247 to /dev/vdb
Nov 21 14:39:32 user nova-compute[74882]: DEBUG os_brick.utils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f412b5cc-61a6-4aa9-9259-76397a38db5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[72252222-b0c0-4969-bf3c-94bdc262d57d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a5481-8ee1-4517-a8e3-64018b2a61b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d507284-9b9d-4ace-85f4-2f566d1ae532]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:39:32 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74dde7e-76dd-471c-9f4d-c319c728f403]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG os_brick.utils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating existing volume attachment record: b34baabc-1e5e-413d-914a-b47d023a9245 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updated VIF entry in instance network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d6af7219-0956-4e21-8840-6d7ae0044baf req-d76d0ad3-b2d3-433d-bf65-62f85f6741b4 service nova] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGtPOrZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:38 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:39:38 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:39:38 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[452b56e6-8ab4-42bd-883a-5d495b211500]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:39:38 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38eb73-9345-485c-88a1-556f5cafeccf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247] added
Nov 21 14:39:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[040e4d65-775e-45ca-b570-9402f52ae277]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb9192-359b-489a-a19e-a60e7fe4934f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGtPOrZS {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing instance network info cache due to event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG nova.network.neutron [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGtPOrZS" returned: 0 in 0.051s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb9a63-0573-4b3d-b336-9ddc321b4e93]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGtPOrZS'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c4a24-b2c1-4d4b-b9d9-9cfda4c60229]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[936f07bf-fcca-491f-9b2c-a690ddba5cd3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0370e891-f100-4f75-8a6f-897b695cb46f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260]
Nov 21 14:39:38 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260] successful.
Nov 21 14:39:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f289e-2418-4dac-ae14-228c235ef599]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fdb3c-88f9-4de5-96fd-b931eefe7820]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:39:38 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e62f52-b3bb-425d-9a2a-355f834fdeef]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGtPOrZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:39:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG nova.network.neutron [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updated VIF entry in instance network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG nova.network.neutron [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bc9fbaac-fc4b-4264-89ae-47d77f6a4cdb req-9bb58411-177e-48b7-86ea-181975ad3861 service nova] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23532656363303334', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532656363303334', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:39:39 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:39:39 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:39:39 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:39:39 user nova-compute[74882]:   <serial>726f2986-4d69-45b4-b2d6-89adc9c3c247</serial>
Nov 21 14:39:39 user nova-compute[74882]: </disk>
Nov 21 14:39:39 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:39:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:39:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:39:40 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No VIF found with MAC fa:16:3e:ce:2a:07, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:39:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-f6fca94e-45ad-408a-8787-a4710a1efc11 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.038s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:41 user nova-compute[74882]: INFO nova.compute.manager [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Rescuing
Nov 21 14:39:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:41 user nova-compute[74882]: WARNING nova.compute.manager [req-c76664f1-e3c7-424d-8012-8e58dd045603 req-bed96ccf-1b0c-4a23-a3a9-f35f31e57ecd service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state active and task_state rescuing.
Nov 21 14:39:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance destroyed successfully.
Nov 21 14:39:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Attempting rescue
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74882) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:42 user nova-compute[74882]: INFO nova.compute.manager [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Shelving
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:39:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Creating image(s)
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue" returned: 0 in 0.053s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'migration_context' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.base [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<3c6eb2bb-d1c5-4c7e-940d-f8fda4278170> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Start _get_guest_xml network_info=[{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:ce:2a:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'resources' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.base [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<3c6eb2bb-d1c5-4c7e-940d-f8fda4278170> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'numa_topology' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.base [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<3c6eb2bb-d1c5-4c7e-940d-f8fda4278170> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:39:42 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:39:42 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.base [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<3c6eb2bb-d1c5-4c7e-940d-f8fda4278170> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377885678',display_name='tempest-ServerRescueNegativeTestJSON-server-377885678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377885678',id=38,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3EUcZV03Sh0eKhZjFWG/fQUZmRB6InEf01rFprKzRgYZVIElWC92bAAIdRNw1gr3K3D6aZwel0s/b2WDenRDNkeBJ3+JYjlJQkyF/m6ggGtSjbZh7XNvXlqBIjhS9WTw==',key_name='tempest-keypair-1647412110',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:37:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5xqgzzg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=3c6eb2bb-d1c5-4c7e-940d-f8fda4278170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:ce:2a:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "vif_mac": "fa:16:3e:ce:2a:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.objects.base [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Object Instance<3c6eb2bb-d1c5-4c7e-940d-f8fda4278170> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:39:42 user nova-compute[74882]:   <uuid>3c6eb2bb-d1c5-4c7e-940d-f8fda4278170</uuid>
Nov 21 14:39:42 user nova-compute[74882]:   <name>instance-00000026</name>
Nov 21 14:39:42 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:39:42 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:39:42 user nova-compute[74882]:   <metadata>
Nov 21 14:39:42 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:39:42 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:39:42 user nova-compute[74882]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-377885678</nova:name>
Nov 21 14:39:42 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:39:42</nova:creationTime>
Nov 21 14:39:42 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:39:42 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:39:42 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:39:42 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:39:42 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:39:42 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:39:42 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:39:42 user nova-compute[74882]:       <nova:owner>
Nov 21 14:39:42 user nova-compute[74882]:         <nova:user uuid="4b8ebb88fee544a793fd71ebeee0845f">tempest-ServerRescueNegativeTestJSON-2007417611-project-member</nova:user>
Nov 21 14:39:42 user nova-compute[74882]:         <nova:project uuid="e50c445b6ade47c09380da2248cf5954">tempest-ServerRescueNegativeTestJSON-2007417611</nova:project>
Nov 21 14:39:42 user nova-compute[74882]:       </nova:owner>
Nov 21 14:39:42 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:39:42 user nova-compute[74882]:       <nova:ports>
Nov 21 14:39:42 user nova-compute[74882]:         <nova:port uuid="22839d58-d656-40f7-8fe3-277e0e4d0c46">
Nov 21 14:39:42 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 14:39:42 user nova-compute[74882]:         </nova:port>
Nov 21 14:39:42 user nova-compute[74882]:       </nova:ports>
Nov 21 14:39:42 user nova-compute[74882]:     </nova:instance>
Nov 21 14:39:42 user nova-compute[74882]:   </metadata>
Nov 21 14:39:42 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:39:42 user nova-compute[74882]:     <system>
Nov 21 14:39:42 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:39:42 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:39:42 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:39:42 user nova-compute[74882]:       <entry name="serial">3c6eb2bb-d1c5-4c7e-940d-f8fda4278170</entry>
Nov 21 14:39:42 user nova-compute[74882]:       <entry name="uuid">3c6eb2bb-d1c5-4c7e-940d-f8fda4278170</entry>
Nov 21 14:39:42 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:39:42 user nova-compute[74882]:     </system>
Nov 21 14:39:42 user nova-compute[74882]:   </sysinfo>
Nov 21 14:39:42 user nova-compute[74882]:   <os>
Nov 21 14:39:42 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:39:42 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:39:42 user nova-compute[74882]:   </os>
Nov 21 14:39:42 user nova-compute[74882]:   <features>
Nov 21 14:39:42 user nova-compute[74882]:     <acpi/>
Nov 21 14:39:42 user nova-compute[74882]:     <apic/>
Nov 21 14:39:42 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:39:42 user nova-compute[74882]:   </features>
Nov 21 14:39:42 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:39:42 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:39:42 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:39:42 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:39:42 user nova-compute[74882]:   </clock>
Nov 21 14:39:42 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:39:42 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:39:42 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:39:42 user nova-compute[74882]:   </cpu>
Nov 21 14:39:42 user nova-compute[74882]:   <devices>
Nov 21 14:39:42 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:39:42 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:39:42 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue"/>
Nov 21 14:39:42 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:39:42 user nova-compute[74882]:     </disk>
Nov 21 14:39:42 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:39:42 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:39:42 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk"/>
Nov 21 14:39:42 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:39:42 user nova-compute[74882]:     </disk>
Nov 21 14:39:42 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:39:42 user nova-compute[74882]:       <mac address="fa:16:3e:ce:2a:07"/>
Nov 21 14:39:42 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:39:42 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:39:42 user nova-compute[74882]:       <target dev="tap22839d58-d6"/>
Nov 21 14:39:42 user nova-compute[74882]:     </interface>
Nov 21 14:39:42 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:39:42 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/console.log" append="off"/>
Nov 21 14:39:42 user nova-compute[74882]:     </serial>
Nov 21 14:39:42 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:39:42 user nova-compute[74882]:     <video>
Nov 21 14:39:42 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:39:42 user nova-compute[74882]:     </video>
Nov 21 14:39:42 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:39:42 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:39:42 user nova-compute[74882]:     </rng>
Nov 21 14:39:42 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:39:42 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:39:42 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:39:42 user nova-compute[74882]:     </memballoon>
Nov 21 14:39:42 user nova-compute[74882]:   </devices>
Nov 21 14:39:42 user nova-compute[74882]: </domain>
Nov 21 14:39:42 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:39:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance destroyed successfully.
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:39:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] No VIF found with MAC fa:16:3e:ce:2a:07, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:39:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance destroyed successfully.
Nov 21 14:39:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Beginning cold snapshot process
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk /opt/stack/data/nova/instances/snapshots/tmp6jrxxr6v/d37db12913214e4a8e23b62cd788c0f1 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:43 user nova-compute[74882]: WARNING nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state active and task_state rescuing.
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-unplugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-unplugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:43 user nova-compute[74882]: WARNING nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received unexpected event network-vif-unplugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:43 user nova-compute[74882]: WARNING nova.compute.manager [req-4d992ad0-2eaa-49b1-83a6-a1188ec3c148 req-c6a7df1a-43f1-46d4-90f9-9663aa97f509 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received unexpected event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 21 14:39:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk /opt/stack/data/nova/instances/snapshots/tmp6jrxxr6v/d37db12913214e4a8e23b62cd788c0f1" returned: 0 in 0.564s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Snapshot extracted, beginning image upload
Nov 21 14:39:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:45 user nova-compute[74882]: DEBUG nova.compute.manager [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:46 user nova-compute[74882]: WARNING nova.compute.manager [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state active and task_state rescuing.
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:46 user nova-compute[74882]: WARNING nova.compute.manager [req-b9450387-6169-4c56-ac30-877f38a96886 req-572fcaeb-6783-4da7-b241-ac48db2e8224 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state active and task_state rescuing.
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-bbc150b2-e197-4cdb-a8f5-c45344574afe tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Snapshot image upload complete
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:46 user nova-compute[74882]: INFO nova.compute.manager [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Shelve offloading
Nov 21 14:39:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance destroyed successfully.
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:39:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance destroyed successfully.
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'resources' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1853576747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1853576747',id=39,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNqwzkTWtb1hX9kGeFini4dr4Qww4cxq1yXUj1oAKofGkI6TECTCXonv6lH9zOXCj66y1aFuWoY9I0lVbQGymCq16jTqB4v1oS8eoj6yPpowy36aUXJmDbeRbcool7/A==',key_name='tempest-keypair-682860110',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-lenihi0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member',shelved_at='2023-11-21T14:39:46.672632',shelved_host='user',shelved_image_id='23e514b3-d4b3-47cd-adaf-e9ef79601b9e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=f968b9d7-44c3-42d4-8475-42bf7d3a1f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG os_vif [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04d9285-67, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing instance network info cache due to event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG nova.network.neutron [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd2dbd92-d501-4d0b-a084-c5eef75685d8) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:47 user nova-compute[74882]: INFO os_vif [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67')
Nov 21 14:39:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Deleting instance files /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c_del
Nov 21 14:39:48 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Deletion of /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c_del complete
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:48 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Deleted allocations for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'numa_topology' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.objects.base [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<f968b9d7-44c3-42d4-8475-42bf7d3a1f9c> lazy-loaded attributes: resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.network.neutron [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updated VIF entry in instance network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.network.neutron [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf04d9285-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ff3e257c-ba06-4011-8b38-aa1947df2e70 req-d5f9b939-2d47-446e-97ea-6596f729b135 service nova] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4268aeae-5323-4ec6-8312-77a5736e454e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.631s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 is timed out.
Nov 21 14:39:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully detached device vdb from instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 from the live domain config.
Nov 21 14:39:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdTilkVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c412329f-42ac-4934-8584-a2162ea3c633]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:39:49 user nova-compute[74882]: No targets found.
Nov 21 14:39:49 user nova-compute[74882]: iSNS:
Nov 21 14:39:49 user nova-compute[74882]: No targets found.
Nov 21 14:39:49 user nova-compute[74882]: STATIC:
Nov 21 14:39:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:39:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0
Nov 21 14:39:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247
Nov 21 14:39:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:49 user nova-compute[74882]: FIRMWARE:
Nov 21 14:39:49 user nova-compute[74882]: No targets found.
Nov 21 14:39:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:39:49 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:39:49 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb196c6-db3e-40b5-9904-50aeafb1a2ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe050c7c-8cca-4614-86e1-37ac974e2355]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:49 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:49 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:39:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:49 user nova-compute[74882]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 (non-flash)
Nov 21 14:39:49 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:39:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6c8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755f715-07ea-41b9-a4fd-d718af59d3cd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[97507f6e-1d3c-42dc-89ae-616f958e6d66]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fcf7fa-d4fd-4518-87f4-47ecad4aa7c3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0486f88-c082-4fe7-8d3f-fc671e310b12]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e611c018-b841-4547-a24b-fe720ef72d8a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af38e2d-9923-4408-9263-7aed2e1281e0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260]
Nov 21 14:39:49 user nova-compute[74882]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0, portal: 172.16.0.220,3260] successful.
Nov 21 14:39:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f2b55d-87cc-4bf8-99dc-a02e42aa9617]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== disconnect_volume: return (310ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG nova.objects.instance [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'flavor' on Instance uuid f8bb419d-8cfd-40fd-b570-70d6afb10cb3 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-888700ba-4539-49ee-ba65-ef69bf42d777 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.656s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:50 user nova-compute[74882]: INFO nova.compute.manager [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Terminating instance
Nov 21 14:39:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-vif-unplugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] No waiting events found dispatching network-vif-unplugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-0576a2df-43bf-4514-8ba5-2fa64eb63fc6 req-1c8b26a6-dbe8-4eff-8d94-b5b49a9675ca service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-vif-unplugged-35832af2-de3b-476c-959f-c053228aa8b9 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:39:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Instance destroyed successfully.
Nov 21 14:39:51 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:39:51 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=7879MB free_disk=24.813934326171875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lazy-loading 'resources' on Instance uuid f8bb419d-8cfd-40fd-b570-70d6afb10cb3 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1085701846',display_name='tempest-VolumesSnapshotTestJSON-instance-1085701846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1085701846',id=37,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH29VAkx9vv4ZlpeuG64I+mitrY1w90noGIG6MDOL1GQKBWXSJIUywZ+837obssmxZ7QBlOdeq9ll3dcdHy7cglp2/oFe6E8FeKZVn2m5A4+0qoRp/93rn0O9TP+toFw1g==',key_name='tempest-keypair-2025088500',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eea6fab008a747ef9093b7c92fb27708',ramdisk_id='',reservation_id='r-umx4l0av',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1985664337',owner_user_name='tempest-VolumesSnapshotTestJSON-1985664337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7ad8112276648628ce9669c2445ea81',uuid=f8bb419d-8cfd-40fd-b570-70d6afb10cb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converting VIF {"id": "35832af2-de3b-476c-959f-c053228aa8b9", "address": "fa:16:3e:19:e2:06", "network": {"id": "b177e5d3-406f-4f1a-8e8a-d6f86bba8214", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2053003041-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eea6fab008a747ef9093b7c92fb27708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35832af2-de", "ovs_interfaceid": "35832af2-de3b-476c-959f-c053228aa8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:e2:06,bridge_name='br-int',has_traffic_filtering=True,id=35832af2-de3b-476c-959f-c053228aa8b9,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35832af2-de') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_vif [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:e2:06,bridge_name='br-int',has_traffic_filtering=True,id=35832af2-de3b-476c-959f-c053228aa8b9,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35832af2-de') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35832af2-de, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7087b802-b5e5-4597-891b-badb1243b5d6) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:39:51 user nova-compute[74882]: INFO os_vif [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:e2:06,bridge_name='br-int',has_traffic_filtering=True,id=35832af2-de3b-476c-959f-c053228aa8b9,network=Network(b177e5d3-406f-4f1a-8e8a-d6f86bba8214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35832af2-de')
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdTilkVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:51 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d5946e-77d7-47dc-be01-a748c99ec672]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:39:51 user nova-compute[74882]: No targets found.
Nov 21 14:39:51 user nova-compute[74882]: iSNS:
Nov 21 14:39:51 user nova-compute[74882]: No targets found.
Nov 21 14:39:51 user nova-compute[74882]: STATIC:
Nov 21 14:39:51 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:39:51 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:51 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:51 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247
Nov 21 14:39:51 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:39:51 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:39:51 user nova-compute[74882]: FIRMWARE:
Nov 21 14:39:51 user nova-compute[74882]: No targets found.
Nov 21 14:39:51 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:39:51 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:39:51 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9764ad71-4b49-434b-a7f3-7dbe0fdfdbb0', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad752d54-81b2-48b6-b0ab-d7376e320313]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63bf753-2cd6-4537-bc8a-1b8f4268e196]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:51 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:39:51 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:39:51 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:39:51 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c339e10>, {}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Disconnecting from: [] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] <== disconnect_volume: return (80ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:39:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Deleting instance files /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3_del
Nov 21 14:39:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Deletion of /opt/stack/data/nova/instances/f8bb419d-8cfd-40fd-b570-70d6afb10cb3_del complete
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5a754e62-be65-4faa-a27c-0e4f3b02c842 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:39:51 user nova-compute[74882]: INFO nova.compute.manager [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 21 14:39:51 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:39:51 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:39:52 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:39:52 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:39:52 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:39:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:52 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:52 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Took 1.09 seconds to deallocate network for instance.
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-071bd4e1-24e0-424d-bedc-010e2eba8288 req-4bb79c22-e245-470b-b5d2-8644e088a9e5 service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-vif-deleted-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:53 user nova-compute[74882]: WARNING nova.volume.cinder [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Attachment 4d45ed61-54e7-4fae-9fbd-646ff3fbcd74 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4d45ed61-54e7-4fae-9fbd-646ff3fbcd74. (HTTP 404) (Request-ID: req-c51d4d1a-38af-4702-9b56-54d2c75804f7)
Nov 21 14:39:53 user nova-compute[74882]: INFO nova.compute.manager [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Took 0.03 seconds to detach 1 volumes for instance.
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received event network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Acquiring lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] No waiting events found dispatching network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:39:53 user nova-compute[74882]: WARNING nova.compute.manager [req-d5d4fa51-0b72-4c7f-80e8-09d3627d0da0 req-8f67b2d4-72e7-41bc-bfbe-3e9c2621727e service nova] [instance: f8bb419d-8cfd-40fd-b570-70d6afb10cb3] Received unexpected event network-vif-plugged-35832af2-de3b-476c-959f-c053228aa8b9 for instance with vm_state deleted and task_state None.
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:53 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Deleted allocations for instance f8bb419d-8cfd-40fd-b570-70d6afb10cb3
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c9abb77a-1206-4fde-a75e-364b0c53a845 tempest-VolumesSnapshotTestJSON-1985664337 tempest-VolumesSnapshotTestJSON-1985664337-project-member] Lock "f8bb419d-8cfd-40fd-b570-70d6afb10cb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.790s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating instance_info_cache with network_info: [{"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:39:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-changed-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Refreshing instance network info cache due to event network-changed-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Acquiring lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Acquired lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Refreshing network info cache for port 1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updated VIF entry in instance network info cache for port 1722ec5a-005b-4f1c-aa1c-d2182bb27c0e. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG nova.network.neutron [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updating instance_info_cache with network_info: [{"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-03bd2432-e071-4bf6-9813-c000fbb0a5b6 req-873052dd-6d8f-48f8-9f58-eca4326156d7 service nova] Releasing lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:56 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'flavor' on Instance uuid 7842f8c8-ffe8-4944-afad-61c4a2bc017a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:39:57 user nova-compute[74882]: INFO nova.compute.manager [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Attaching volume 09ce3d53-49a8-4d3a-8497-f846d3be0e58 to /dev/vdb
Nov 21 14:39:57 user nova-compute[74882]: DEBUG os_brick.utils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e56377-5a20-47b2-8cf6-22a9002de49d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e710f6ac-105a-4ffe-9034-23ba7d041876]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed13524-343b-429d-b974-7f074da92934]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc352e-c194-4994-930b-359cc4b80494]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:39:57 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd0818d-1724-43c8-a00f-5313cf5a3a9e]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG os_brick.utils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updating existing volume attachment record: 9248db44-d661-4ad5-b616-e2cc19a27c1c {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-changed-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Refreshing instance network info cache due to event network-changed-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Acquiring lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Acquired lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:39:57 user nova-compute[74882]: DEBUG nova.network.neutron [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Refreshing network info cache for port 59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:39:58 user nova-compute[74882]: DEBUG nova.network.neutron [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Updated VIF entry in instance network info cache for port 59b81b61-a9e0-4a60-853e-9f1a43a0ef2a. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:39:58 user nova-compute[74882]: DEBUG nova.network.neutron [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Updating instance_info_cache with network_info: [{"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:39:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e1bb4ea0-175b-4b0f-8e79-8021c3166cbc req-6eafe15d-1f57-4208-9f79-993c5972d2f3 service nova] Releasing lock "refresh_cache-e5c578a4-87f5-4c67-af63-c9ac43b64ddf" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:40:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lazy-loading 'flavor' on Instance uuid e5c578a4-87f5-4c67-af63-c9ac43b64ddf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:40:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:01 user nova-compute[74882]: INFO nova.compute.manager [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Attaching volume 8a0d3248-1890-4b38-85f1-bf170f5baca2 to /dev/vdb
Nov 21 14:40:01 user nova-compute[74882]: DEBUG os_brick.utils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a92b1e-3281-4ed7-90ed-bd9a87c5b643]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9091bb1a-33f7-4739-8059-4c903dea5aeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[609241f2-9ab7-446c-b340-65a2afa594be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b358a3d-e23d-416b-9748-dbb5ee528e5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:40:01 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:40:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a955df28-c2b7-4788-8556-728a35f29574]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG os_brick.utils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Updating existing volume attachment record: b327ed75-d935-4757-b273-9e102b520616 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:40:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKPDeETL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:40:03 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:40:03 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:40:03 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86721a1-96c1-433f-bc54-1d44132ee834]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:40:03 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[388cf41b-c412-4524-8571-077624abccc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58] added
Nov 21 14:40:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9d3ca0-25a5-40eb-a124-ea41ce5b0b5e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8228a776-ca07-4d14-b687-8882f6900ab6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKPDeETL {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKPDeETL" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[967eecf1-4850-46b6-9c43-0b09d787061e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKPDeETL'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27e4762-b20b-40ba-8544-4a63d0099968]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b037972-5b2a-454e-bada-0a98b0cea7cc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e82ff6-8c80-4e4d-aa8a-e8219106199e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260]
Nov 21 14:40:03 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260] successful.
Nov 21 14:40:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad950b29-f52d-4f9c-82f7-a6220ef357ca]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebebc41-4acd-4e0e-957e-26fd14c51fcd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4c8224-0d82-4b48-b944-b439c384446b]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:40:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKPDeETL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:40:04 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:40:04 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26162323164386562', 'path': '/dev/sdd'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:40:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162323164386562', 'path': '/dev/sdd'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:40:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'flavor' on Instance uuid 7842f8c8-ffe8-4944-afad-61c4a2bc017a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:40:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:40:04 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:40:04 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:40:04 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:40:04 user nova-compute[74882]:   <serial>09ce3d53-49a8-4d3a-8497-f846d3be0e58</serial>
Nov 21 14:40:04 user nova-compute[74882]: </disk>
Nov 21 14:40:04 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:40:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:40:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:40:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] No VIF found with MAC fa:16:3e:fb:8d:38, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:40:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c4107a5d-20b0-4600-9636-47cb764d543a tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.163s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:07 user nova-compute[74882]: INFO nova.compute.manager [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Detaching volume 09ce3d53-49a8-4d3a-8497-f846d3be0e58
Nov 21 14:40:07 user nova-compute[74882]: INFO nova.virt.block_device [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Attempting to driver detach volume 09ce3d53-49a8-4d3a-8497-f846d3be0e58 from mountpoint /dev/vdb
Nov 21 14:40:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Attempting to detach device vdb from instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:40:07 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:40:07 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:40:07 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:40:07 user nova-compute[74882]:   <serial>09ce3d53-49a8-4d3a-8497-f846d3be0e58</serial>
Nov 21 14:40:07 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:40:07 user nova-compute[74882]: </disk>
Nov 21 14:40:07 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:40:07 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully detached device vdb from instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a from the persistent domain config.
Nov 21 14:40:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:40:07 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:40:07 user nova-compute[74882]:   <source dev="/dev/sdd"/>
Nov 21 14:40:07 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:40:07 user nova-compute[74882]:   <serial>09ce3d53-49a8-4d3a-8497-f846d3be0e58</serial>
Nov 21 14:40:07 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:40:07 user nova-compute[74882]: </disk>
Nov 21 14:40:07 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYSZkIsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:40:07 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:40:07 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:40:07 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae18a4-1170-43c8-afaa-66c53f71c2b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:40:07 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea24d8a3-a2f3-4944-ac91-dd28e96f10d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2] added
Nov 21 14:40:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae536b3-9522-4086-87d3-72747a050ae8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da6cdc-ee57-405f-8023-22ce2e431d0c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYSZkIsr {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CYSZkIsr" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b320c4-4d3c-42ff-b617-ab10c3046556]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CYSZkIsr'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[67260def-f9e2-49bf-a9df-2c4ddf1de4a3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[97939845-0cf6-4cff-a6a6-6d39ea95895a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ab953f-d72a-4bd4-9677-aff3b36a7c18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260]
Nov 21 14:40:07 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260] successful.
Nov 21 14:40:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02d2ee-cc60-48a0-aeca-9eb7f5a53f95]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f5080a-716b-4697-b173-244204cb8367]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)
Nov 21 14:40:07 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31f2541-546f-4ac8-b973-c76a09535f9b]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:07 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYSZkIsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23166646162343765', 'path': '/dev/sde'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166646162343765', 'path': '/dev/sde'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lazy-loading 'flavor' on Instance uuid e5c578a4-87f5-4c67-af63-c9ac43b64ddf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:40:08 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:40:08 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:40:08 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:40:08 user nova-compute[74882]:   <serial>8a0d3248-1890-4b38-85f1-bf170f5baca2</serial>
Nov 21 14:40:08 user nova-compute[74882]: </disk>
Nov 21 14:40:08 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:08 user nova-compute[74882]: INFO nova.compute.manager [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Terminating instance
Nov 21 14:40:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received event network-vif-unplugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] No waiting events found dispatching network-vif-unplugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-c1e23a91-5a32-4ef9-8570-1f1a8a0b83d1 req-f3d0fe1e-efd8-4ea0-a1d0-70df6590f473 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received event network-vif-unplugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] No VIF found with MAC fa:16:3e:27:55:7e, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b1733bf8-ebc9-4ed5-8f56-0131c9a00b71 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.280s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Instance destroyed successfully.
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.objects.instance [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'resources' on Instance uuid 5a754e62-be65-4faa-a27c-0e4f3b02c842 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:30:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1454925154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1454925154',id=31,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:30:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-4pfzfj11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:32:43Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=5a754e62-be65-4faa-a27c-0e4f3b02c842,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "address": "fa:16:3e:d0:f4:9e", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b5cbded-88", "ovs_interfaceid": "6b5cbded-889d-4a11-a500-ce0bc10fdfa0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:f4:9e,bridge_name='br-int',has_traffic_filtering=True,id=6b5cbded-889d-4a11-a500-ce0bc10fdfa0,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5cbded-88') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG os_vif [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:f4:9e,bridge_name='br-int',has_traffic_filtering=True,id=6b5cbded-889d-4a11-a500-ce0bc10fdfa0,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5cbded-88') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b5cbded-88, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0425e85b-98e6-4abd-a9e8-b972dca70dc9) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:09 user nova-compute[74882]: INFO os_vif [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:f4:9e,bridge_name='br-int',has_traffic_filtering=True,id=6b5cbded-889d-4a11-a500-ce0bc10fdfa0,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b5cbded-88')
Nov 21 14:40:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Deleting instance files /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842_del
Nov 21 14:40:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Deletion of /opt/stack/data/nova/instances/5a754e62-be65-4faa-a27c-0e4f3b02c842_del complete
Nov 21 14:40:09 user nova-compute[74882]: INFO nova.compute.manager [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 21 14:40:09 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:40:09 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:40:10 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Took 0.64 seconds to deallocate network for instance.
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-7f571015-cdef-48e7-b8d8-d7790bedeace req-e454aa69-97e3-4009-b4a2-8b38453c6913 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received event network-vif-deleted-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:10 user nova-compute[74882]: INFO nova.compute.manager [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Detaching volume 8a0d3248-1890-4b38-85f1-bf170f5baca2
Nov 21 14:40:10 user nova-compute[74882]: INFO nova.virt.block_device [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Attempting to driver detach volume 8a0d3248-1890-4b38-85f1-bf170f5baca2 from mountpoint /dev/vdb
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Attempting to detach device vdb from instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:40:10 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:40:10 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:40:10 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:40:10 user nova-compute[74882]:   <serial>8a0d3248-1890-4b38-85f1-bf170f5baca2</serial>
Nov 21 14:40:10 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:40:10 user nova-compute[74882]: </disk>
Nov 21 14:40:10 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:40:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Successfully detached device vdb from instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf from the persistent domain config.
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:40:10 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:40:10 user nova-compute[74882]:   <source dev="/dev/sde"/>
Nov 21 14:40:10 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:40:10 user nova-compute[74882]:   <serial>8a0d3248-1890-4b38-85f1-bf170f5baca2</serial>
Nov 21 14:40:10 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:40:10 user nova-compute[74882]: </disk>
Nov 21 14:40:10 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:40:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:10 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Deleted allocations for instance 5a754e62-be65-4faa-a27c-0e4f3b02c842
Nov 21 14:40:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-634f6ae5-59fa-434f-b525-226ce5d1a1df tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:40:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received event network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:40:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Acquiring lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] Lock "5a754e62-be65-4faa-a27c-0e4f3b02c842-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] No waiting events found dispatching network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:40:11 user nova-compute[74882]: WARNING nova.compute.manager [req-e4ca2d42-f4db-4d48-bb4e-682537099027 req-2116758e-0e9f-4162-8442-fe57c9d52211 service nova] [instance: 5a754e62-be65-4faa-a27c-0e4f3b02c842] Received unexpected event network-vif-plugged-6b5cbded-889d-4a11-a500-ce0bc10fdfa0 for instance with vm_state deleted and task_state None.
Nov 21 14:40:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:27 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a is timed out.
Nov 21 14:40:27 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully detached device vdb from instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a from the live domain config.
Nov 21 14:40:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKPDeETL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:40:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0325a99-d8d6-4a89-811d-1aa2aef4b49c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:40:27 user nova-compute[74882]: No targets found.
Nov 21 14:40:27 user nova-compute[74882]: iSNS:
Nov 21 14:40:27 user nova-compute[74882]: No targets found.
Nov 21 14:40:27 user nova-compute[74882]: STATIC:
Nov 21 14:40:27 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:40:27 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:40:27 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:40:27 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2
Nov 21 14:40:27 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:40:27 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:40:27 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58
Nov 21 14:40:27 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:40:27 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:40:27 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247
Nov 21 14:40:27 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:40:27 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:40:27 user nova-compute[74882]: FIRMWARE:
Nov 21 14:40:27 user nova-compute[74882]: No targets found.
Nov 21 14:40:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:40:27 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:40:27 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b41eea-f602-4dfd-a72f-53737e95c54f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a178bf8-1f57-4623-bca0-487d1b6c8f13]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)
Nov 21 14:40:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c555090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58'): ({'sdd'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Removing single pathed devices sdd {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[601a7b66-3d39-4e59-9760-823b7639bf49]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a5ba66-ab16-43b8-979d-7b90f73fda8d]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Flushing IO for device /dev/sdd {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ded6ed-7fa9-4d65-970e-ff89f0c76f72]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[04776447-562e-4435-99f8-8d9232ffb05b]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] SCSI volumes sdd have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7804867-e8ef-4065-9787-64c16852779d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[29853184-3a09-4375-b04a-90aeb138d238]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260]
Nov 21 14:40:27 user nova-compute[74882]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58, portal: 172.16.0.220,3260] successful.
Nov 21 14:40:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce3d53-49a8-4d3a-8497-f846d3be0e58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9406f2c4-fccc-4a6a-9d71-a960684165ef]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] <== disconnect_volume: return (306ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:40:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:40:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'flavor' on Instance uuid 7842f8c8-ffe8-4944-afad-61c4a2bc017a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:40:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6e311cdd-3346-4e57-97e6-b62d917a5c78 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:31 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf is timed out.
Nov 21 14:40:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Successfully detached device vdb from instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf from the live domain config.
Nov 21 14:40:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CYSZkIsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:40:31 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be9e78b-44e6-4fa0-8d84-7dd70c094a97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:40:31 user nova-compute[74882]: No targets found.
Nov 21 14:40:31 user nova-compute[74882]: iSNS:
Nov 21 14:40:31 user nova-compute[74882]: No targets found.
Nov 21 14:40:31 user nova-compute[74882]: STATIC:
Nov 21 14:40:31 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:40:31 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:40:31 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:40:31 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2
Nov 21 14:40:31 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:40:31 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:40:31 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247
Nov 21 14:40:31 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:40:31 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:40:31 user nova-compute[74882]: FIRMWARE:
Nov 21 14:40:31 user nova-compute[74882]: No targets found.
Nov 21 14:40:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:40:31 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:40:31 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef7fea-0045-4ad4-a936-8f649b8df322]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[780a43c5-06be-4fd3-87aa-9dc343301537]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:31 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:31 user nova-compute[74882]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)
Nov 21 14:40:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:40:31 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:40:31 user nova-compute[74882]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 (non-flash)
Nov 21 14:40:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6ca0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2'): ({'sde'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Removing single pathed devices sde {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1819dc-d85f-46fb-bd08-999902870fb0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c03423b-3448-4da8-9161-406c2925062b]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Flushing IO for device /dev/sde {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[803da17e-e57e-4085-8fae-87d53d484d56]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8cc37-89f3-45b9-bc75-f436003da48e]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] SCSI volumes sde have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ff063d-4811-4e9d-8b2f-0c0a7ccb53f6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03312ef-0cdb-492f-ae1c-c482fdfda7b1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260]
Nov 21 14:40:31 user nova-compute[74882]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2, portal: 172.16.0.220,3260] successful.
Nov 21 14:40:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a0d3248-1890-4b38-85f1-bf170f5baca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f96d57f-642e-4462-81b6-de13f25c82f6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] <== disconnect_volume: return (286ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:40:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:40:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lazy-loading 'flavor' on Instance uuid e5c578a4-87f5-4c67-af63-c9ac43b64ddf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:40:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bbfe5c1c-80c2-4c6d-a87f-5f1c74571c2f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.659s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:40:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:40:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:40:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8037MB free_disk=24.938400268554688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:40:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:40:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:40:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:40:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:40:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:40:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-changed-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Refreshing instance network info cache due to event network-changed-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Acquiring lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Acquired lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.network.neutron [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Refreshing network info cache for port 1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:58 user nova-compute[74882]: INFO nova.compute.manager [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Terminating instance
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.network.neutron [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updated VIF entry in instance network info cache for port 1722ec5a-005b-4f1c-aa1c-d2182bb27c0e. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.network.neutron [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updating instance_info_cache with network_info: [{"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c61ee3b6-b294-4846-91f6-a45901cd1a9c req-a1d96790-ac51-4aea-a5ad-81cf9dc9e82a service nova] Releasing lock "refresh_cache-7842f8c8-ffe8-4944-afad-61c4a2bc017a" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-unplugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] No waiting events found dispatching network-vif-unplugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-e39541e2-b4b9-45fa-a67b-2344c765c04b req-20e349b1-9702-4588-b308-1e6b476a2bfa service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-unplugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Instance destroyed successfully.
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'resources' on Instance uuid 7842f8c8-ffe8-4944-afad-61c4a2bc017a {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1746098191',display_name='tempest-TestStampPattern-server-1746098191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1746098191',id=40,image_ref='3f571ea2-6206-4ad2-b9fe-0a6c5862686a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH5NG9mjIsga52s0kRKH9IrZe7eb8u0uHJimILwFq6gc6XeS9P2KhDI3bZMrALH0JW9EBkiPZJdps54hxAky6TAI2RrDSglRCp0u6RTSK0kGXjhWDxXPScCdj6QO4CfoQ==',key_name='tempest-TestStampPattern-124603786',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce558a840a8c4055a42b197328a0d13a',ramdisk_id='',reservation_id='r-889aq2a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff',image_min_disk='1',image_min_ram='0',image_owner_id='ce558a840a8c4055a42b197328a0d13a',image_owner_project_name='tempest-TestStampPattern-1219016270',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1219016270-project-member',image_user_id='eafb1966d06e4d688566d1b5af779c17',owner_project_name='tempest-TestStampPattern-1219016270',owner_user_name='tempest-TestStampPattern-1219016270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:38:15Z,user_data=None,user_id='eafb1966d06e4d688566d1b5af779c17',uuid=7842f8c8-ffe8-4944-afad-61c4a2bc017a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converting VIF {"id": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "address": "fa:16:3e:fb:8d:38", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1722ec5a-00", "ovs_interfaceid": "1722ec5a-005b-4f1c-aa1c-d2182bb27c0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:8d:38,bridge_name='br-int',has_traffic_filtering=True,id=1722ec5a-005b-4f1c-aa1c-d2182bb27c0e,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1722ec5a-00') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG os_vif [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:8d:38,bridge_name='br-int',has_traffic_filtering=True,id=1722ec5a-005b-4f1c-aa1c-d2182bb27c0e,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1722ec5a-00') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1722ec5a-00, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ab76fab-6816-484e-9f12-28bf69fdda5b) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:58 user nova-compute[74882]: INFO os_vif [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:8d:38,bridge_name='br-int',has_traffic_filtering=True,id=1722ec5a-005b-4f1c-aa1c-d2182bb27c0e,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1722ec5a-00')
Nov 21 14:40:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Deleting instance files /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a_del
Nov 21 14:40:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Deletion of /opt/stack/data/nova/instances/7842f8c8-ffe8-4944-afad-61c4a2bc017a_del complete
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: INFO nova.compute.manager [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:59 user nova-compute[74882]: INFO nova.compute.manager [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Terminating instance
Nov 21 14:40:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Took 0.48 seconds to deallocate network for instance.
Nov 21 14:40:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-e99d2d57-4e5f-4357-af2a-a75e248c591d req-db655884-3c4d-43e3-8437-9219a65a3bdf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-deleted-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:40:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:40:59 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Deleted allocations for instance 7842f8c8-ffe8-4944-afad-61c4a2bc017a
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c22610bf-66a9-48df-8441-6e6b43d43747 tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.877s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Instance destroyed successfully.
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'resources' on Instance uuid 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-677425991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-677425991',id=22,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:27:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-jwp56qp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:28:59Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=5dddf05e-1c0b-42a2-8fd0-22ce4a539d44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "2af316c0-8063-431b-b1a8-cdb069de9c03", "address": "fa:16:3e:86:06:ac", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af316c0-80", "ovs_interfaceid": "2af316c0-8063-431b-b1a8-cdb069de9c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_vif [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2af316c0-80, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4637086-ea3c-4d5d-8cc5-4ffbc19b87a2) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:00 user nova-compute[74882]: INFO os_vif [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:06:ac,bridge_name='br-int',has_traffic_filtering=True,id=2af316c0-8063-431b-b1a8-cdb069de9c03,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2af316c0-80')
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLoreNDm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:41:00 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e27a2a-0ac6-4a70-a832-1793f2d2cb24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:41:00 user nova-compute[74882]: No targets found.
Nov 21 14:41:00 user nova-compute[74882]: iSNS:
Nov 21 14:41:00 user nova-compute[74882]: No targets found.
Nov 21 14:41:00 user nova-compute[74882]: STATIC:
Nov 21 14:41:00 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750
Nov 21 14:41:00 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:41:00 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:41:00 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247
Nov 21 14:41:00 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:41:00 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:41:00 user nova-compute[74882]: FIRMWARE:
Nov 21 14:41:00 user nova-compute[74882]: No targets found.
Nov 21 14:41:00 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:41:00 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:41:00 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e472d586-bd5a-404e-b103-7b41008f56f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[81777bdb-9f23-448f-83f5-072acc987735]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:41:00 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:41:00 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 (non-flash)
Nov 21 14:41:00 user nova-compute[74882]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:41:00 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c730430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4decc386-40d1-42f7-b1dc-278587639613]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb51e2-f3f9-4fcd-b6b6-ed2597a81d67]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8333cf-4237-4292-9d7d-ee273600331c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fee74a-dafc-4370-91c8-a46862a5d4f7]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4f1b00-9292-455a-9ad9-386d909ae7ec]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e4b77-0cd9-471c-b7e1-8a7ef85b3808]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260]
Nov 21 14:41:00 user nova-compute[74882]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750, portal: 172.16.0.220,3260] successful.
Nov 21 14:41:00 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cea0a613-7c3f-40c3-8a2a-fe3d8871e750 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d12c5b-7f83-4091-a14b-bb5543f71766]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] <== disconnect_volume: return (287ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:41:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Deleting instance files /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44_del
Nov 21 14:41:00 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Deletion of /opt/stack/data/nova/instances/5dddf05e-1c0b-42a2-8fd0-22ce4a539d44_del complete
Nov 21 14:41:00 user nova-compute[74882]: INFO nova.compute.manager [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] No waiting events found dispatching network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:00 user nova-compute[74882]: WARNING nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received unexpected event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance with vm_state deleted and task_state None.
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] No waiting events found dispatching network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:00 user nova-compute[74882]: WARNING nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received unexpected event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance with vm_state deleted and task_state None.
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Acquiring lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] Lock "7842f8c8-ffe8-4944-afad-61c4a2bc017a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] No waiting events found dispatching network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:00 user nova-compute[74882]: WARNING nova.compute.manager [req-73ac0549-7d5c-4ffa-bf99-db7c07d79c9a req-7e9d19ab-193f-434d-be09-8c330a77edaf service nova] [instance: 7842f8c8-ffe8-4944-afad-61c4a2bc017a] Received unexpected event network-vif-plugged-1722ec5a-005b-4f1c-aa1c-d2182bb27c0e for instance with vm_state deleted and task_state None.
Nov 21 14:41:01 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:01 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Took 0.58 seconds to deallocate network for instance.
Nov 21 14:41:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-unplugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Acquiring lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] No waiting events found dispatching network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:01 user nova-compute[74882]: WARNING nova.compute.manager [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received unexpected event network-vif-plugged-2af316c0-8063-431b-b1a8-cdb069de9c03 for instance with vm_state active and task_state deleting.
Nov 21 14:41:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-080b4d9e-5bf3-4007-8883-1ba496f3bedb req-fbba6b9f-4c84-4761-ab04-25e55fc680f7 service nova] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Received event network-vif-deleted-2af316c0-8063-431b-b1a8-cdb069de9c03 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:01 user nova-compute[74882]: INFO nova.compute.manager [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44] Took 0.74 seconds to detach 1 volumes for instance.
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:02 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:41:02 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:41:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:02 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Deleted allocations for instance 5dddf05e-1c0b-42a2-8fd0-22ce4a539d44
Nov 21 14:41:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-3ea45bc5-f536-4dbe-8c84-8c4425e7230f tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "5dddf05e-1c0b-42a2-8fd0-22ce4a539d44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.947s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:04 user nova-compute[74882]: INFO nova.compute.manager [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Terminating instance
Nov 21 14:41:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-vif-unplugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] No waiting events found dispatching network-vif-unplugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-a131c7ff-bc81-4b93-8ff6-7bb9b336de0f req-7356105b-5b93-440c-b441-3f86de6213d1 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-vif-unplugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Instance destroyed successfully.
Nov 21 14:41:05 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lazy-loading 'resources' on Instance uuid e5c578a4-87f5-4c67-af63-c9ac43b64ddf {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:38:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-333310994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3333109',id=41,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7PaMj3KH/QGatcwq0x+nUcN5bBnhHMcFTnS+cH5MeUvdSTZmhPdcZHh+E3loIVrYH1ccXRsi/n46ZW3DCpKPbS0mAMWfCIKqFtKhkvvQyrfqUz4nX8XYs13PYioP8weA==',key_name='tempest-keypair-1230849473',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:38:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c6598be22e24ce3801f37d80c2b7c51',ramdisk_id='',reservation_id='r-4ugc3n68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1834514172',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be4482694f814db8bd913d090863c1e5',uuid=e5c578a4-87f5-4c67-af63-c9ac43b64ddf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Converting VIF {"id": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "address": "fa:16:3e:27:55:7e", "network": {"id": "f8a78092-9e30-4479-a70f-0ef5046d7d9b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-559625160-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c6598be22e24ce3801f37d80c2b7c51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b81b61-a9", "ovs_interfaceid": "59b81b61-a9e0-4a60-853e-9f1a43a0ef2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:55:7e,bridge_name='br-int',has_traffic_filtering=True,id=59b81b61-a9e0-4a60-853e-9f1a43a0ef2a,network=Network(f8a78092-9e30-4479-a70f-0ef5046d7d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b81b61-a9') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG os_vif [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:55:7e,bridge_name='br-int',has_traffic_filtering=True,id=59b81b61-a9e0-4a60-853e-9f1a43a0ef2a,network=Network(f8a78092-9e30-4479-a70f-0ef5046d7d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b81b61-a9') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59b81b61-a9, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=174089ef-ffa2-4fc3-b835-bc53358b4822) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:05 user nova-compute[74882]: INFO os_vif [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:55:7e,bridge_name='br-int',has_traffic_filtering=True,id=59b81b61-a9e0-4a60-853e-9f1a43a0ef2a,network=Network(f8a78092-9e30-4479-a70f-0ef5046d7d9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b81b61-a9')
Nov 21 14:41:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Deleting instance files /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf_del
Nov 21 14:41:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Deletion of /opt/stack/data/nova/instances/e5c578a4-87f5-4c67-af63-c9ac43b64ddf_del complete
Nov 21 14:41:05 user nova-compute[74882]: INFO nova.compute.manager [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 21 14:41:05 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:41:05 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:06 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Took 0.98 seconds to deallocate network for instance.
Nov 21 14:41:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Acquiring lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] No waiting events found dispatching network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:06 user nova-compute[74882]: WARNING nova.compute.manager [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received unexpected event network-vif-plugged-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a for instance with vm_state deleted and task_state None.
Nov 21 14:41:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-614ade0d-809f-41c7-9fcc-6fb4bc688ecc req-f072d94b-7bc1-4e40-9ad8-e70846adcda6 service nova] [instance: e5c578a4-87f5-4c67-af63-c9ac43b64ddf] Received event network-vif-deleted-59b81b61-a9e0-4a60-853e-9f1a43a0ef2a {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:41:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:06 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Deleted allocations for instance e5c578a4-87f5-4c67-af63-c9ac43b64ddf
Nov 21 14:41:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b42c0efa-5eaa-40ab-acff-cc46f62b007f tempest-TestServerVolumeAttachScenarioOldVersion-1834514172 tempest-TestServerVolumeAttachScenarioOldVersion-1834514172-project-member] Lock "e5c578a4-87f5-4c67-af63-c9ac43b64ddf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.609s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:41:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:41:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:41:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:41:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:41:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:41:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:32 user nova-compute[74882]: INFO nova.compute.manager [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Unrescuing
Nov 21 14:41:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:32 user nova-compute[74882]: WARNING nova.compute.manager [req-de914e94-0563-4d25-b3f2-4e5b7fc6a33e req-9a116b3e-10b3-4e85-ae63-427ad7c139c7 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:41:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance destroyed successfully.
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:34 user nova-compute[74882]: WARNING nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:34 user nova-compute[74882]: WARNING nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:34 user nova-compute[74882]: WARNING nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:34 user nova-compute[74882]: WARNING nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:34 user nova-compute[74882]: WARNING nova.compute.manager [req-bfac45d2-b557-4870-b729-7ab52a619087 req-f90f5afa-6511-407b-b5b6-4d1c44ab5ef9 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:34 user nova-compute[74882]: INFO nova.compute.manager [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Unshelving
Nov 21 14:41:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:35 user nova-compute[74882]: INFO nova.virt.block_device [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Booting with volume a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d at /dev/vdc
Nov 21 14:41:35 user nova-compute[74882]: DEBUG os_brick.utils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d5ea56-f206-4427-9bd6-47a6d124e974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7265834-d77d-418e-9458-f099a01fc984]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4bddf0-b024-4e7d-b397-e852fc327b3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e4a50-6d0a-4e3b-abaa-f8d3eb4cfa0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:41:35 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:41:35 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c14015e-0126-45f0-b7a1-a1fdb2a9f6fd]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG os_brick.utils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating existing volume attachment record: f5d69930-9dcb-47a3-abf8-a5ad96ecd794 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:41:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-33ed837c-d4c2-4e77-8dbd-d7c701264343 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:36 user nova-compute[74882]: WARNING nova.compute.manager [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state active and task_state None.
Nov 21 14:41:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:36 user nova-compute[74882]: WARNING nova.compute.manager [req-ba13fe49-5995-4ef3-8a52-95d395f28387 req-12d22722-8246-4a77-97e0-59ec94f5041c service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state active and task_state None.
Nov 21 14:41:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:41 user nova-compute[74882]: DEBUG nova.objects.instance [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'pci_requests' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:41 user nova-compute[74882]: DEBUG nova.objects.instance [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'numa_topology' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:41:41 user nova-compute[74882]: INFO nova.compute.claims [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Claim successful on node user
Nov 21 14:41:41 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:41:41 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:41:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:41 user nova-compute[74882]: INFO nova.network.neutron [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating port f04d9285-6760-4f9d-bfdf-e8187db846d5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.compute.manager [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.compute.manager [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing instance network info cache due to event network-changed-f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:41:42 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Creating image(s)
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.objects.instance [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'trusted_certs' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.network.neutron [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Refreshing network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG nova.objects.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<f968b9d7-44c3-42d4-8475-42bf7d3a1f9c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "bcd8c990ab9b06064a0a3bdb301a3848340cb70c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "bcd8c990ab9b06064a0a3bdb301a3848340cb70c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:43 user nova-compute[74882]: DEBUG nova.virt.images [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 23e514b3-d4b3-47cd-adaf-e9ef79601b9e was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:41:43 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:41:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.part /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updated VIF entry in instance network info cache for port f04d9285-6760-4f9d-bfdf-e8187db846d5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-33f5cfae-79b2-430d-83bb-1624d2091293 req-53f6bc8e-e058-4123-a723-6b2c0a0ac995 service nova] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.part /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.converted" returned: 0 in 0.722s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "bcd8c990ab9b06064a0a3bdb301a3848340cb70c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.242s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "bcd8c990ab9b06064a0a3bdb301a3848340cb70c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "bcd8c990ab9b06064a0a3bdb301a3848340cb70c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c --force-share --output=json" returned: 0 in 0.165s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c,backing_fmt=raw /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c,backing_fmt=raw /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk 1073741824" returned: 0 in 0.046s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "bcd8c990ab9b06064a0a3bdb301a3848340cb70c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG nova.objects.instance [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'migration_context' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG nova.objects.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<f968b9d7-44c3-42d4-8475-42bf7d3a1f9c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:41:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Rebasing disk image.
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d -F raw /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d -F raw /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk" returned: 0 in 2.412s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Start _get_guest_xml network_info=[{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='10a068bce67fd2f423fe27e631045335',container_format='bare',created_at=2023-11-21T14:39:42Z,direct_url=<?>,disk_format='qcow2',id=23e514b3-d4b3-47cd-adaf-e9ef79601b9e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1853576747-shelved',owner='47eba7494a3b42929f2007ff8162d9bb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-21T14:39:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfYpyvuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f968b9d7-44c3-42d4-8475-42bf7d3a1f9c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d', 'serial': 'a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'f5d69930-9dcb-47a3-abf8-a5ad96ecd794', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:41:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:41:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='10a068bce67fd2f423fe27e631045335',container_format='bare',created_at=2023-11-21T14:39:42Z,direct_url=<?>,disk_format='qcow2',id=23e514b3-d4b3-47cd-adaf-e9ef79601b9e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1853576747-shelved',owner='47eba7494a3b42929f2007ff8162d9bb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-21T14:39:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.objects.instance [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'vcpu_model' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.objects.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<f968b9d7-44c3-42d4-8475-42bf7d3a1f9c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfYpyvuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:41:48 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:41:48 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:41:48 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:41:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8374MB free_disk=24.869983673095703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a661a620-e296-45fb-a4c9-17895431079b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:41:48 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4e45df-cb8d-4e7c-b2fe-e0d6633a5058]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d] added
Nov 21 14:41:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[68261b67-a35a-47d4-8816-419309982674]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9367f956-5224-48b6-ae9f-71610a91346a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AfYpyvuP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AfYpyvuP" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (f2c18da1-f4fd-49b6-a78a-043389a6ebfc): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66f98a8-d392-430f-9e0f-3150c012164f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AfYpyvuP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bc8eeb-06e7-4818-af7b-aa0d3e2ebc6a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d82d530-1b1a-4e87-b429-b504ba4fbd18]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:41:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:41:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[334c8362-a71a-4ddb-8f6e-ba3331df0528]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260]
Nov 21 14:41:48 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260] successful.
Nov 21 14:41:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8dd56-c5a1-4630-a6a8-42d2046c0dfc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fc253c-9533-4fc4-a769-365a73dfd32d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:41:48 user nova-compute[74882]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)
Nov 21 14:41:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:41:48 user nova-compute[74882]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)
Nov 21 14:41:48 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[441ad2d8-e537-4564-b7c3-0cd435fd3069]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:41:48 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:41:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfYpyvuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:41:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:41:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:41:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:41:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26434356239626263', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434356239626263', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1853576747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1853576747',id=39,image_ref='23e514b3-d4b3-47cd-adaf-e9ef79601b9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-682860110',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-lenihi0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member',shelved_at='2023-11-21T14:39:46.672632',shelved_host='user',shelved_image_id='23e514b3-d4b3-47cd-adaf-e9ef79601b9e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=f968b9d7-44c3-42d4-8475-42bf7d3a1f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.objects.instance [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'pci_devices' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.objects.base [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<f968b9d7-44c3-42d4-8475-42bf7d3a1f9c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:41:50 user nova-compute[74882]:   <uuid>f968b9d7-44c3-42d4-8475-42bf7d3a1f9c</uuid>
Nov 21 14:41:50 user nova-compute[74882]:   <name>instance-00000027</name>
Nov 21 14:41:50 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:41:50 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:41:50 user nova-compute[74882]:   <metadata>
Nov 21 14:41:50 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:41:50 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:41:50 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1853576747</nova:name>
Nov 21 14:41:50 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:41:48</nova:creationTime>
Nov 21 14:41:50 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:41:50 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:41:50 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:41:50 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:41:50 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:41:50 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:41:50 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:41:50 user nova-compute[74882]:       <nova:owner>
Nov 21 14:41:50 user nova-compute[74882]:         <nova:user uuid="a0bd7642251d4e968bb108362dee3a3b">tempest-AttachVolumeShelveTestJSON-1109379350-project-member</nova:user>
Nov 21 14:41:50 user nova-compute[74882]:         <nova:project uuid="47eba7494a3b42929f2007ff8162d9bb">tempest-AttachVolumeShelveTestJSON-1109379350</nova:project>
Nov 21 14:41:50 user nova-compute[74882]:       </nova:owner>
Nov 21 14:41:50 user nova-compute[74882]:       <nova:root type="image" uuid="23e514b3-d4b3-47cd-adaf-e9ef79601b9e"/>
Nov 21 14:41:50 user nova-compute[74882]:       <nova:ports>
Nov 21 14:41:50 user nova-compute[74882]:         <nova:port uuid="f04d9285-6760-4f9d-bfdf-e8187db846d5">
Nov 21 14:41:50 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 21 14:41:50 user nova-compute[74882]:         </nova:port>
Nov 21 14:41:50 user nova-compute[74882]:       </nova:ports>
Nov 21 14:41:50 user nova-compute[74882]:     </nova:instance>
Nov 21 14:41:50 user nova-compute[74882]:   </metadata>
Nov 21 14:41:50 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:41:50 user nova-compute[74882]:     <system>
Nov 21 14:41:50 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:41:50 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:41:50 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:41:50 user nova-compute[74882]:       <entry name="serial">f968b9d7-44c3-42d4-8475-42bf7d3a1f9c</entry>
Nov 21 14:41:50 user nova-compute[74882]:       <entry name="uuid">f968b9d7-44c3-42d4-8475-42bf7d3a1f9c</entry>
Nov 21 14:41:50 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:41:50 user nova-compute[74882]:     </system>
Nov 21 14:41:50 user nova-compute[74882]:   </sysinfo>
Nov 21 14:41:50 user nova-compute[74882]:   <os>
Nov 21 14:41:50 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:41:50 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:41:50 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:41:50 user nova-compute[74882]:   </os>
Nov 21 14:41:50 user nova-compute[74882]:   <features>
Nov 21 14:41:50 user nova-compute[74882]:     <acpi/>
Nov 21 14:41:50 user nova-compute[74882]:     <apic/>
Nov 21 14:41:50 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:41:50 user nova-compute[74882]:   </features>
Nov 21 14:41:50 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:41:50 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:41:50 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:41:50 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:41:50 user nova-compute[74882]:   </clock>
Nov 21 14:41:50 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:41:50 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:41:50 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:41:50 user nova-compute[74882]:   </cpu>
Nov 21 14:41:50 user nova-compute[74882]:   <devices>
Nov 21 14:41:50 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:41:50 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:41:50 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk"/>
Nov 21 14:41:50 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:41:50 user nova-compute[74882]:     </disk>
Nov 21 14:41:50 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:41:50 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:41:50 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:41:50 user nova-compute[74882]:       <target dev="vdc" bus="virtio"/>
Nov 21 14:41:50 user nova-compute[74882]:       <serial>a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d</serial>
Nov 21 14:41:50 user nova-compute[74882]:     </disk>
Nov 21 14:41:50 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:41:50 user nova-compute[74882]:       <mac address="fa:16:3e:a5:44:ea"/>
Nov 21 14:41:50 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:41:50 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:41:50 user nova-compute[74882]:       <target dev="tapf04d9285-67"/>
Nov 21 14:41:50 user nova-compute[74882]:     </interface>
Nov 21 14:41:50 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:41:50 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/console.log" append="off"/>
Nov 21 14:41:50 user nova-compute[74882]:     </serial>
Nov 21 14:41:50 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:41:50 user nova-compute[74882]:     <video>
Nov 21 14:41:50 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:41:50 user nova-compute[74882]:     </video>
Nov 21 14:41:50 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:41:50 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:41:50 user nova-compute[74882]:     </rng>
Nov 21 14:41:50 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:41:50 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:41:50 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:41:50 user nova-compute[74882]:     </memballoon>
Nov 21 14:41:50 user nova-compute[74882]:   </devices>
Nov 21 14:41:50 user nova-compute[74882]: </domain>
Nov 21 14:41:50 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1853576747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1853576747',id=39,image_ref='23e514b3-d4b3-47cd-adaf-e9ef79601b9e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-682860110',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-lenihi0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member',shelved_at='2023-11-21T14:39:46.672632',shelved_host='user',shelved_image_id='23e514b3-d4b3-47cd-adaf-e9ef79601b9e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=f968b9d7-44c3-42d4-8475-42bf7d3a1f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG os_vif [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '282bb02b-a4ab-5a09-94f7-e67483ada540', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04d9285-67, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf04d9285-67, col_values=(('qos', UUID('f9551db4-f4ad-4855-b819-9ad72d881eef')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf04d9285-67, col_values=(('external_ids', {'iface-id': 'f04d9285-6760-4f9d-bfdf-e8187db846d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:44:ea', 'vm-uuid': 'f968b9d7-44c3-42d4-8475-42bf7d3a1f9c'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: INFO os_vif [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67')
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No VIF found with MAC fa:16:3e:a5:44:ea, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:50 user nova-compute[74882]: INFO nova.compute.manager [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Terminating instance
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received event network-vif-unplugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] No waiting events found dispatching network-vif-unplugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-43a5d302-cb4d-4a16-9c30-44dd044cb3fb req-a6e12ba3-0d8d-4a6a-b8a1-3368fb7e18bd service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received event network-vif-unplugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:41:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Instance destroyed successfully.
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lazy-loading 'resources' on Instance uuid eeb0740f-ac2c-44ca-9b16-d61f8f1cb968 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1151244324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1151244324',id=17,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:22:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96e5113ec65d46c4b8859c4658433b02',ramdisk_id='',reservation_id='r-jd9gvutz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:24:08Z,user_data=None,user_id='7635b3029cf14950a1978282d06bc8f3',uuid=eeb0740f-ac2c-44ca-9b16-d61f8f1cb968,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converting VIF {"id": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "address": "fa:16:3e:91:90:fa", "network": {"id": "25c54848-a31e-4a8b-acba-2675da8ba572", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1941304053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96e5113ec65d46c4b8859c4658433b02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb7f672-16", "ovs_interfaceid": "feb7f672-16b6-449a-8b69-5b3ef5573e1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=feb7f672-16b6-449a-8b69-5b3ef5573e1c,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb7f672-16') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG os_vif [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=feb7f672-16b6-449a-8b69-5b3ef5573e1c,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb7f672-16') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeb7f672-16, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1b85066-9e98-4ecd-9c9d-21fb505fd560) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: INFO os_vif [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:90:fa,bridge_name='br-int',has_traffic_filtering=True,id=feb7f672-16b6-449a-8b69-5b3ef5573e1c,network=Network(25c54848-a31e-4a8b-acba-2675da8ba572),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb7f672-16')
Nov 21 14:41:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Deleting instance files /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968_del
Nov 21 14:41:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Deletion of /opt/stack/data/nova/instances/eeb0740f-ac2c-44ca-9b16-d61f8f1cb968_del complete
Nov 21 14:41:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:41:51 user nova-compute[74882]: INFO nova.compute.manager [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 21 14:41:51 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updating instance_info_cache with network_info: [{"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-ebf25b5a-9531-4058-8e86-372fef1517e0" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:52 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Took 0.69 seconds to deallocate network for instance.
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received event network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Acquiring lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] No waiting events found dispatching network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:52 user nova-compute[74882]: WARNING nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received unexpected event network-vif-plugged-feb7f672-16b6-449a-8b69-5b3ef5573e1c for instance with vm_state deleted and task_state None.
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:52 user nova-compute[74882]: WARNING nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received unexpected event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: eeb0740f-ac2c-44ca-9b16-d61f8f1cb968] Received event network-vif-deleted-feb7f672-16b6-449a-8b69-5b3ef5573e1c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:52 user nova-compute[74882]: WARNING nova.compute.manager [req-0d2a44b2-42fd-4e82-b297-f4f96d7c9170 req-6328d335-0604-4cb4-8387-de450db9b9e2 service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received unexpected event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:52 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Deleted allocations for instance eeb0740f-ac2c-44ca-9b16-d61f8f1cb968
Nov 21 14:41:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c7a1f824-fdc7-4fe6-9b47-cf2dbecda8d4 tempest-ServerBootFromVolumeStableRescueTest-1086017756 tempest-ServerBootFromVolumeStableRescueTest-1086017756-project-member] Lock "eeb0740f-ac2c-44ca-9b16-d61f8f1cb968" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.683s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:54 user nova-compute[74882]: DEBUG nova.compute.manager [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:41:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:41:54 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance spawned successfully.
Nov 21 14:41:54 user nova-compute[74882]: DEBUG nova.compute.manager [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:41:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-52d4208e-5832-4fbf-a689-71f64b7a4d13 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.628s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-changed-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Refreshing instance network info cache due to event network-changed-2173b2c8-e047-4709-ab98-0e5f6d077f8c. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Acquiring lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Acquired lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.network.neutron [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Refreshing network info cache for port 2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:57 user nova-compute[74882]: INFO nova.compute.manager [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Terminating instance
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.network.neutron [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updated VIF entry in instance network info cache for port 2173b2c8-e047-4709-ab98-0e5f6d077f8c. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.network.neutron [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updating instance_info_cache with network_info: [{"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-vif-unplugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] No waiting events found dispatching network-vif-unplugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-809ce908-b70f-4438-89dc-e900491a09c9 req-5503fc2b-47f4-4060-84cc-cb77c9ce5367 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-vif-unplugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:41:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-333db394-781a-4a71-891f-6ab87f27bff0 req-2cd045df-0257-4022-bfe8-011e8d36753f service nova] Releasing lock "refresh_cache-1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Instance destroyed successfully.
Nov 21 14:41:58 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lazy-loading 'resources' on Instance uuid 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-744241441',display_name='tempest-TestStampPattern-server-744241441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-744241441',id=36,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHH5NG9mjIsga52s0kRKH9IrZe7eb8u0uHJimILwFq6gc6XeS9P2KhDI3bZMrALH0JW9EBkiPZJdps54hxAky6TAI2RrDSglRCp0u6RTSK0kGXjhWDxXPScCdj6QO4CfoQ==',key_name='tempest-TestStampPattern-124603786',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:35:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce558a840a8c4055a42b197328a0d13a',ramdisk_id='',reservation_id='r-g7lazw2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1219016270',owner_user_name='tempest-TestStampPattern-1219016270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:38:03Z,user_data=None,user_id='eafb1966d06e4d688566d1b5af779c17',uuid=1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converting VIF {"id": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "address": "fa:16:3e:ee:76:39", "network": {"id": "406f84de-7ca7-4822-a0b8-6ccad53522c0", "bridge": "br-int", "label": "tempest-TestStampPattern-2108943449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce558a840a8c4055a42b197328a0d13a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2173b2c8-e0", "ovs_interfaceid": "2173b2c8-e047-4709-ab98-0e5f6d077f8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:76:39,bridge_name='br-int',has_traffic_filtering=True,id=2173b2c8-e047-4709-ab98-0e5f6d077f8c,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2173b2c8-e0') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG os_vif [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:76:39,bridge_name='br-int',has_traffic_filtering=True,id=2173b2c8-e047-4709-ab98-0e5f6d077f8c,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2173b2c8-e0') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2173b2c8-e0, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd3d0e0a-ba45-40a7-9f3b-10d2109b3fa4) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:41:58 user nova-compute[74882]: INFO os_vif [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:76:39,bridge_name='br-int',has_traffic_filtering=True,id=2173b2c8-e047-4709-ab98-0e5f6d077f8c,network=Network(406f84de-7ca7-4822-a0b8-6ccad53522c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2173b2c8-e0')
Nov 21 14:41:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Deleting instance files /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff_del
Nov 21 14:41:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Deletion of /opt/stack/data/nova/instances/1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff_del complete
Nov 21 14:41:58 user nova-compute[74882]: INFO nova.compute.manager [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 21 14:41:58 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:41:58 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:41:59 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:59 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Took 0.52 seconds to deallocate network for instance.
Nov 21 14:41:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-vif-deleted-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:41:59 user nova-compute[74882]: INFO nova.compute.manager [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Neutron deleted interface 2173b2c8-e047-4709-ab98-0e5f6d077f8c; detaching it from the instance and deleting it from the info cache
Nov 21 14:41:59 user nova-compute[74882]: DEBUG nova.network.neutron [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:41:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-15b45ce1-3cd3-4902-acc0-24c0ed35475a req-3888dc4f-f691-4a84-a00c-6d7c95c05ce9 service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Detach interface failed, port_id=2173b2c8-e047-4709-ab98-0e5f6d077f8c, reason: Instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:41:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:41:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:41:59 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:41:59 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:41:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:41:59 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Deleted allocations for instance 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff
Nov 21 14:41:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6d2168f1-5d21-48d6-b529-80fef0f40b7f tempest-TestStampPattern-1219016270 tempest-TestStampPattern-1219016270-project-member] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received event network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:42:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Acquiring lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] Lock "1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] No waiting events found dispatching network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:42:00 user nova-compute[74882]: WARNING nova.compute.manager [req-458734cd-951d-4dfb-93b2-a18c288d00a8 req-8fccbe15-c13b-4bf3-8077-c0bc43b994be service nova] [instance: 1fa0f1d7-2aa2-4fa2-b223-9e8e2b5b4dff] Received unexpected event network-vif-plugged-2173b2c8-e047-4709-ab98-0e5f6d077f8c for instance with vm_state deleted and task_state None.
Nov 21 14:42:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:42:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:42:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:42:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:42:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:42:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:42:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:42:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=25.179733276367188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:42:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:42:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:42:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:42:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:42:52 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:42:53 user nova-compute[74882]: INFO nova.compute.claims [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Claim successful on node user
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.policy [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6dc4469b07049be829644dfecf5745e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35cfaa913094e829acc68857bba4d55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:42:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Creating image(s)
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.190s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk 1073741824" returned: 0 in 0.062s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Successfully created port: 9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.189s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Cannot resize image /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Ensure instance console log exists: /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Successfully updated port: 9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG nova.compute.manager [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing instance network info cache due to event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:42:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.neutron [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance network_info: |[{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.neutron [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Start _get_guest_xml network_info=[{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:42:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:42:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-133109328',display_name='tempest-ServerStableDeviceRescueTest-server-133109328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-133109328',id=42,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHNmtipo1wU5OMs2w2xiTJOR6qMSY/j0Cp9ebE0YDGN2Tt3kxaT2nhewhyeEiRj0ugTAPd8QBkOGXJIMLvcE7YmsWU9Xk4fM78Vj52XJL9sQFqG1gb6MIB0acIEKHcZg==',key_name='tempest-keypair-1394726022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35cfaa913094e829acc68857bba4d55',ramdisk_id='',reservation_id='r-rm0rskwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-218360850',owner_user_name='tempest-ServerStableDeviceRescueTest-218360850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6dc4469b07049be829644dfecf5745e',uuid=2be9dfed-8102-4797-9d47-13041ed0a4ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converting VIF {"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.objects.instance [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'pci_devices' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:42:55 user nova-compute[74882]:   <uuid>2be9dfed-8102-4797-9d47-13041ed0a4ef</uuid>
Nov 21 14:42:55 user nova-compute[74882]:   <name>instance-0000002a</name>
Nov 21 14:42:55 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:42:55 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:42:55 user nova-compute[74882]:   <metadata>
Nov 21 14:42:55 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:42:55 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:42:55 user nova-compute[74882]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-133109328</nova:name>
Nov 21 14:42:55 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:42:55</nova:creationTime>
Nov 21 14:42:55 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:42:55 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:42:55 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:42:55 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:42:55 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:42:55 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:42:55 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:42:55 user nova-compute[74882]:       <nova:owner>
Nov 21 14:42:55 user nova-compute[74882]:         <nova:user uuid="b6dc4469b07049be829644dfecf5745e">tempest-ServerStableDeviceRescueTest-218360850-project-member</nova:user>
Nov 21 14:42:55 user nova-compute[74882]:         <nova:project uuid="c35cfaa913094e829acc68857bba4d55">tempest-ServerStableDeviceRescueTest-218360850</nova:project>
Nov 21 14:42:55 user nova-compute[74882]:       </nova:owner>
Nov 21 14:42:55 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:42:55 user nova-compute[74882]:       <nova:ports>
Nov 21 14:42:55 user nova-compute[74882]:         <nova:port uuid="9c201a78-a3ad-4da1-9620-26544a9493b9">
Nov 21 14:42:55 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:42:55 user nova-compute[74882]:         </nova:port>
Nov 21 14:42:55 user nova-compute[74882]:       </nova:ports>
Nov 21 14:42:55 user nova-compute[74882]:     </nova:instance>
Nov 21 14:42:55 user nova-compute[74882]:   </metadata>
Nov 21 14:42:55 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:42:55 user nova-compute[74882]:     <system>
Nov 21 14:42:55 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:42:55 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:42:55 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:42:55 user nova-compute[74882]:       <entry name="serial">2be9dfed-8102-4797-9d47-13041ed0a4ef</entry>
Nov 21 14:42:55 user nova-compute[74882]:       <entry name="uuid">2be9dfed-8102-4797-9d47-13041ed0a4ef</entry>
Nov 21 14:42:55 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:42:55 user nova-compute[74882]:     </system>
Nov 21 14:42:55 user nova-compute[74882]:   </sysinfo>
Nov 21 14:42:55 user nova-compute[74882]:   <os>
Nov 21 14:42:55 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:42:55 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:42:55 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:42:55 user nova-compute[74882]:   </os>
Nov 21 14:42:55 user nova-compute[74882]:   <features>
Nov 21 14:42:55 user nova-compute[74882]:     <acpi/>
Nov 21 14:42:55 user nova-compute[74882]:     <apic/>
Nov 21 14:42:55 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:42:55 user nova-compute[74882]:   </features>
Nov 21 14:42:55 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:42:55 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:42:55 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:42:55 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:42:55 user nova-compute[74882]:   </clock>
Nov 21 14:42:55 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:42:55 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:42:55 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:42:55 user nova-compute[74882]:   </cpu>
Nov 21 14:42:55 user nova-compute[74882]:   <devices>
Nov 21 14:42:55 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:42:55 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:42:55 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk"/>
Nov 21 14:42:55 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:42:55 user nova-compute[74882]:     </disk>
Nov 21 14:42:55 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:42:55 user nova-compute[74882]:       <mac address="fa:16:3e:46:36:47"/>
Nov 21 14:42:55 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:42:55 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:42:55 user nova-compute[74882]:       <target dev="tap9c201a78-a3"/>
Nov 21 14:42:55 user nova-compute[74882]:     </interface>
Nov 21 14:42:55 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:42:55 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/console.log" append="off"/>
Nov 21 14:42:55 user nova-compute[74882]:     </serial>
Nov 21 14:42:55 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:42:55 user nova-compute[74882]:     <video>
Nov 21 14:42:55 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:42:55 user nova-compute[74882]:     </video>
Nov 21 14:42:55 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:42:55 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:42:55 user nova-compute[74882]:     </rng>
Nov 21 14:42:55 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:42:55 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:42:55 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:42:55 user nova-compute[74882]:     </memballoon>
Nov 21 14:42:55 user nova-compute[74882]:   </devices>
Nov 21 14:42:55 user nova-compute[74882]: </domain>
Nov 21 14:42:55 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-133109328',display_name='tempest-ServerStableDeviceRescueTest-server-133109328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-133109328',id=42,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHNmtipo1wU5OMs2w2xiTJOR6qMSY/j0Cp9ebE0YDGN2Tt3kxaT2nhewhyeEiRj0ugTAPd8QBkOGXJIMLvcE7YmsWU9Xk4fM78Vj52XJL9sQFqG1gb6MIB0acIEKHcZg==',key_name='tempest-keypair-1394726022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35cfaa913094e829acc68857bba4d55',ramdisk_id='',reservation_id='r-rm0rskwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-218360850',owner_user_name='tempest-ServerStableDeviceRescueTest-218360850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6dc4469b07049be829644dfecf5745e',uuid=2be9dfed-8102-4797-9d47-13041ed0a4ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converting VIF {"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG os_vif [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97809917-6b73-5982-867b-f2281691e843', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c201a78-a3, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c201a78-a3, col_values=(('qos', UUID('0ab23c34-6783-4907-b80a-c844d9b0bba6')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c201a78-a3, col_values=(('external_ids', {'iface-id': '9c201a78-a3ad-4da1-9620-26544a9493b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:36:47', 'vm-uuid': '2be9dfed-8102-4797-9d47-13041ed0a4ef'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:55 user nova-compute[74882]: INFO os_vif [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3')
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No VIF found with MAC fa:16:3e:46:36:47, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.neutron [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updated VIF entry in instance network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG nova.network.neutron [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:42:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-13952700-f2b0-43ed-aed0-74087ae87017 req-f59a6b3d-5c79-48c0-913e-021e9b8f02ab service nova] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:42:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG nova.compute.manager [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:42:57 user nova-compute[74882]: WARNING nova.compute.manager [req-ab3dcfe6-9158-4a4b-ac14-66c892125cf9 req-b065bfd8-0bf1-49fc-a6e3-088e62f8ebc9 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state building and task_state spawning.
Nov 21 14:42:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:42:59 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance spawned successfully.
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:42:59 user nova-compute[74882]: INFO nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:42:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:42:59 user nova-compute[74882]: WARNING nova.compute.manager [req-eca5b573-4210-428f-a6cc-4a8cc3936dce req-70112bbe-d874-4b53-9ce8-813e03b71778 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state building and task_state spawning.
Nov 21 14:42:59 user nova-compute[74882]: INFO nova.compute.manager [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Took 6.10 seconds to build instance.
Nov 21 14:42:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-e2c5562a-49e9-4ded-8833-798c41001887 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.190s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:43:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:43:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:43:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:43:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:43:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:43:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing instance network info cache due to event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:43:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:43:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:43:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.network.neutron [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updated VIF entry in instance network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.network.neutron [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-65752d2f-05de-4641-8183-bd4f425ddfc4 req-ffa85eb7-9c29-4acf-9b60-8d9121999400 service nova] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:43:24 user nova-compute[74882]: INFO nova.compute.manager [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Detaching volume 726f2986-4d69-45b4-b2d6-89adc9c3c247
Nov 21 14:43:24 user nova-compute[74882]: INFO nova.virt.block_device [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Attempting to driver detach volume 726f2986-4d69-45b4-b2d6-89adc9c3c247 from mountpoint /dev/vdb
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Attempting to detach device vdb from instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:43:24 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:43:24 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:43:24 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:43:24 user nova-compute[74882]:   <serial>726f2986-4d69-45b4-b2d6-89adc9c3c247</serial>
Nov 21 14:43:24 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:43:24 user nova-compute[74882]: </disk>
Nov 21 14:43:24 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:43:24 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully detached device vdb from instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 from the persistent domain config.
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:43:24 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:43:24 user nova-compute[74882]:   <source dev="/dev/sdc"/>
Nov 21 14:43:24 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:43:24 user nova-compute[74882]:   <serial>726f2986-4d69-45b4-b2d6-89adc9c3c247</serial>
Nov 21 14:43:24 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:43:24 user nova-compute[74882]: </disk>
Nov 21 14:43:24 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:43:24 user nova-compute[74882]: INFO nova.compute.manager [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Detaching volume a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d
Nov 21 14:43:24 user nova-compute[74882]: INFO nova.virt.block_device [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Attempting to driver detach volume a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d from mountpoint /dev/vdc
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Attempting to detach device vdc from instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:43:24 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:43:24 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:43:24 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:43:24 user nova-compute[74882]:   <serial>a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d</serial>
Nov 21 14:43:24 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:43:24 user nova-compute[74882]: </disk>
Nov 21 14:43:24 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:43:24 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully detached device vdc from instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c from the persistent domain config.
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:43:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:43:24 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:43:24 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:43:24 user nova-compute[74882]:   <target dev="vdc" bus="virtio"/>
Nov 21 14:43:24 user nova-compute[74882]:   <serial>a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d</serial>
Nov 21 14:43:24 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:43:24 user nova-compute[74882]: </disk>
Nov 21 14:43:24 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:43:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:43:25 user nova-compute[74882]: DEBUG nova.compute.manager [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:43:25 user nova-compute[74882]: DEBUG nova.compute.manager [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing instance network info cache due to event network-changed-22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:43:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Acquiring lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:43:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Acquired lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:43:25 user nova-compute[74882]: DEBUG nova.network.neutron [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Refreshing network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:43:26 user nova-compute[74882]: DEBUG nova.network.neutron [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updated VIF entry in instance network info cache for port 22839d58-d656-40f7-8fe3-277e0e4d0c46. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:43:26 user nova-compute[74882]: DEBUG nova.network.neutron [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [{"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:43:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d00c6180-e9b2-4a6d-91e7-01ec207c4fb0 req-db2896ec-a360-46df-9750-1d99b6a8b685 service nova] Releasing lock "refresh_cache-3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:43:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:43:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:43:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:43:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:43:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:44 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 is timed out.
Nov 21 14:43:44 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully detached device vdb from instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 from the live domain config.
Nov 21 14:43:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGtPOrZS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:43:44 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde6173-a2b2-4d5b-8cb3-fcc1e396206b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:43:44 user nova-compute[74882]: No targets found.
Nov 21 14:43:44 user nova-compute[74882]: iSNS:
Nov 21 14:43:44 user nova-compute[74882]: No targets found.
Nov 21 14:43:44 user nova-compute[74882]: STATIC:
Nov 21 14:43:44 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d
Nov 21 14:43:44 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:43:44 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:43:44 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247
Nov 21 14:43:44 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:43:44 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:43:44 user nova-compute[74882]: FIRMWARE:
Nov 21 14:43:44 user nova-compute[74882]: No targets found.
Nov 21 14:43:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:43:44 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:43:44 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16b51a2-bdaf-42bb-b263-fb6108731f00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[58486515-f0b0-4a4b-899a-e71cdbd9e9d2]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:43:44 user nova-compute[74882]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)
Nov 21 14:43:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 (non-flash)
Nov 21 14:43:44 user nova-compute[74882]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)
Nov 21 14:43:44 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c5ee200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f608fd5-6447-4f42-b9ba-9e15724829be]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bbc6a-a664-4b0c-92e2-e4868c9183b4]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4ba8f4-74b9-4eb9-a003-2bcc996789f3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:43:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea86d596-6d43-4f23-8695-8ca475a225ac]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08395f9-9509-49a2-acc7-90d46269f11e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d722ab2-6218-41b5-9282-df1959d071c2]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260]
Nov 21 14:43:45 user nova-compute[74882]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247, portal: 172.16.0.220,3260] successful.
Nov 21 14:43:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:726f2986-4d69-45b4-b2d6-89adc9c3c247 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[99636df2-dcc5-4a50-8c3b-37814b0937b8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] <== disconnect_volume: return (265ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:43:45 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c is timed out.
Nov 21 14:43:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully detached device vdc from instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c from the live domain config.
Nov 21 14:43:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AfYpyvuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:43:45 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2821e6-b76f-41aa-8f2b-fe1a44fe5313]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:43:45 user nova-compute[74882]: No targets found.
Nov 21 14:43:45 user nova-compute[74882]: iSNS:
Nov 21 14:43:45 user nova-compute[74882]: No targets found.
Nov 21 14:43:45 user nova-compute[74882]: STATIC:
Nov 21 14:43:45 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d
Nov 21 14:43:45 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:43:45 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:43:45 user nova-compute[74882]: FIRMWARE:
Nov 21 14:43:45 user nova-compute[74882]: No targets found.
Nov 21 14:43:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:43:45 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:43:45 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd3219-2e5a-46eb-9568-0c20b9a2f549]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01c6468-ba2d-4902-acfb-4a28c46395b7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)
Nov 21 14:43:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d (non-flash)
Nov 21 14:43:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c424e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1ca614-c932-448b-b362-f3339cec5288]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba26e997-144b-4fa6-99ac-b787ddd04a41]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7578f5-3f1a-4167-ada5-8ea3e4c6b929]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd8c74-b3d8-416b-a958-ef40912400a7]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4d32d-2f96-4b52-b203-79ff2e9850ef]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dd2349-248c-41c3-98ca-291fd3de535d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260]
Nov 21 14:43:45 user nova-compute[74882]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d, portal: 172.16.0.220,3260] successful.
Nov 21 14:43:45 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6c3bf41-b5aa-42ef-8fba-8071efdc9c6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a40c16a-c0ab-428e-97fa-2bc905b85172]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] <== disconnect_volume: return (317ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'flavor' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:43:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c73b710a-82c8-4f25-9451-d6177e883e3d tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG nova.objects.instance [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'flavor' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0bc03f43-0d0a-4a66-9650-7fd6deb9658e tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:43:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:43:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:43:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=25.148189544677734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:43:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:43:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:43:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:43:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:43:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:43:53 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:43:54 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [{"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:43:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:43:54 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:43:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:43:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:43:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:43:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:43:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:43:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:43:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:43:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:44:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:44:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:44:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:14 user nova-compute[74882]: INFO nova.compute.manager [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Terminating instance
Nov 21 14:44:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG nova.compute.manager [req-a00624cb-3293-4c8e-af1d-4530204da844 req-80eec1d1-9ad0-40d3-8707-665e706bcebc service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-unplugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:15 user nova-compute[74882]: INFO nova.compute.manager [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Terminating instance
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Instance destroyed successfully.
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'resources' on Instance uuid 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:37:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-377885678',display_name='tempest-ServerRescueNegativeTestJSON-server-377885678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-377885678',id=38,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3EUcZV03Sh0eKhZjFWG/fQUZmRB6InEf01rFprKzRgYZVIElWC92bAAIdRNw1gr3K3D6aZwel0s/b2WDenRDNkeBJ3+JYjlJQkyF/m6ggGtSjbZh7XNvXlqBIjhS9WTw==',key_name='tempest-keypair-1647412110',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5xqgzzg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=3c6eb2bb-d1c5-4c7e-940d-f8fda4278170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "address": "fa:16:3e:ce:2a:07", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22839d58-d6", "ovs_interfaceid": "22839d58-d656-40f7-8fe3-277e0e4d0c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG os_vif [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22839d58-d6, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95e68084-3df5-4cc2-b17d-c36465b05606) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: INFO os_vif [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:2a:07,bridge_name='br-int',has_traffic_filtering=True,id=22839d58-d656-40f7-8fe3-277e0e4d0c46,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22839d58-d6')
Nov 21 14:44:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Deleting instance files /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170_del
Nov 21 14:44:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Deletion of /opt/stack/data/nova/instances/3c6eb2bb-d1c5-4c7e-940d-f8fda4278170_del complete
Nov 21 14:44:15 user nova-compute[74882]: INFO nova.compute.manager [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 21 14:44:15 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:44:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Instance destroyed successfully.
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'resources' on Instance uuid f968b9d7-44c3-42d4-8475-42bf7d3a1f9c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1853576747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1853576747',id=39,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEBNqwzkTWtb1hX9kGeFini4dr4Qww4cxq1yXUj1oAKofGkI6TECTCXonv6lH9zOXCj66y1aFuWoY9I0lVbQGymCq16jTqB4v1oS8eoj6yPpowy36aUXJmDbeRbcool7/A==',key_name='tempest-keypair-682860110',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-lenihi0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=f968b9d7-44c3-42d4-8475-42bf7d3a1f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "address": "fa:16:3e:a5:44:ea", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d9285-67", "ovs_interfaceid": "f04d9285-6760-4f9d-bfdf-e8187db846d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG os_vif [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04d9285-67, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9551db4-f4ad-4855-b819-9ad72d881eef) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:15 user nova-compute[74882]: INFO os_vif [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:44:ea,bridge_name='br-int',has_traffic_filtering=True,id=f04d9285-6760-4f9d-bfdf-e8187db846d5,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d9285-67')
Nov 21 14:44:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Deleting instance files /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c_del
Nov 21 14:44:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Deletion of /opt/stack/data/nova/instances/f968b9d7-44c3-42d4-8475-42bf7d3a1f9c_del complete
Nov 21 14:44:16 user nova-compute[74882]: INFO nova.compute.manager [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:44:16 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Took 1.00 seconds to deallocate network for instance.
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:44:16 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Deleted allocations for instance 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170
Nov 21 14:44:16 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Took 0.83 seconds to deallocate network for instance.
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Acquiring lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] No waiting events found dispatching network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:44:16 user nova-compute[74882]: WARNING nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received unexpected event network-vif-plugged-22839d58-d656-40f7-8fe3-277e0e4d0c46 for instance with vm_state deleted and task_state None.
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-unplugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-unplugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-unplugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Acquiring lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] No waiting events found dispatching network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:44:16 user nova-compute[74882]: WARNING nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received unexpected event network-vif-plugged-f04d9285-6760-4f9d-bfdf-e8187db846d5 for instance with vm_state active and task_state deleting.
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-bfb2034f-fa11-4514-8a7a-b4708f1d8d4e req-303105aa-329e-4b77-87d1-c890f4d106ff service nova] [instance: 3c6eb2bb-d1c5-4c7e-940d-f8fda4278170] Received event network-vif-deleted-22839d58-d656-40f7-8fe3-277e0e4d0c46 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-64b5d9d2-7ccc-435a-bad7-e940dc3bca19 req-dec27cf1-e8a4-4d22-a046-33573342547c service nova] [instance: f968b9d7-44c3-42d4-8475-42bf7d3a1f9c] Received event network-vif-deleted-f04d9285-6760-4f9d-bfdf-e8187db846d5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-d0be298c-2b6c-4174-bf4a-8ea1730ab4b8 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "3c6eb2bb-d1c5-4c7e-940d-f8fda4278170" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:17 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:44:17 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:44:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:17 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Deleted allocations for instance f968b9d7-44c3-42d4-8475-42bf7d3a1f9c
Nov 21 14:44:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c930a9fb-842e-45c3-ac35-b9c6590383e1 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "f968b9d7-44c3-42d4-8475-42bf7d3a1f9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:44:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:44:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:44:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG nova.compute.manager [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing instance network info cache due to event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updated VIF entry in instance network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:44:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e19f3e82-b280-40b2-9458-ed7fff82122b req-e62e212a-c39f-4a56-ac6c-685def832d06 service nova] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:44:45 user nova-compute[74882]: INFO nova.compute.manager [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] instance snapshotting
Nov 21 14:44:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Beginning live snapshot process
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json -f qcow2 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbrzn_189/8e97fd4d38014add99aa5d61e81cefb7.delta 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbrzn_189/8e97fd4d38014add99aa5d61e81cefb7.delta 1073741824" returned: 0 in 0.057s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 21 14:44:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:44:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74882) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 21 14:44:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 21 14:44:47 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbrzn_189/8e97fd4d38014add99aa5d61e81cefb7.delta /opt/stack/data/nova/instances/snapshots/tmpbrzn_189/8e97fd4d38014add99aa5d61e81cefb7 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbrzn_189/8e97fd4d38014add99aa5d61e81cefb7.delta /opt/stack/data/nova/instances/snapshots/tmpbrzn_189/8e97fd4d38014add99aa5d61e81cefb7" returned: 0 in 0.593s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Snapshot extracted, beginning image upload
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:44:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:44:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=25.15203094482422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance ebf25b5a-9531-4058-8e86-372fef1517e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:44:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:44:50 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:44:50 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:44:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:44:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:44:50 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Snapshot image upload complete
Nov 21 14:44:50 user nova-compute[74882]: INFO nova.compute.manager [None req-0ed71846-ddb7-4902-834f-0d7c582ec7b6 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Took 5.11 seconds to snapshot the instance on the hypervisor.
Nov 21 14:44:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:44:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:44:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:44:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:44:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:44:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:45:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:08 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:45:08 user nova-compute[74882]: INFO nova.compute.claims [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Claim successful on node user
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:45:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.policy [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0bd7642251d4e968bb108362dee3a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47eba7494a3b42929f2007ff8162d9bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:45:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Creating image(s)
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.186s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk 1073741824" returned: 0 in 0.060s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.213s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Successfully created port: bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Cannot resize image /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Successfully updated port: bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing instance network info cache due to event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance network_info: |[{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Start _get_guest_xml network_info=[{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:45:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:45:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-744304248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-744304248',id=43,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWSWM7hKRLSDhHNLt8+WbBMqDCHWTKHdi/qT5EvjhUmMORwEUFq8yP0AXHv5t4D2CKrfo4oSwn7TwNq1eJ0+LVIeelZCR9xZsBuHTuZi19lUSNdrfgNSdbgCudlVnYvrw==',key_name='tempest-keypair-1578555145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-8ibbq2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=3cf2345b-bb3d-4bab-a89a-ca50af5fd539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:45:11 user nova-compute[74882]:   <uuid>3cf2345b-bb3d-4bab-a89a-ca50af5fd539</uuid>
Nov 21 14:45:11 user nova-compute[74882]:   <name>instance-0000002b</name>
Nov 21 14:45:11 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:45:11 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:45:11 user nova-compute[74882]:   <metadata>
Nov 21 14:45:11 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:45:11 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:45:11 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-744304248</nova:name>
Nov 21 14:45:11 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:45:11</nova:creationTime>
Nov 21 14:45:11 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:45:11 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:45:11 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:45:11 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:45:11 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:45:11 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:45:11 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:45:11 user nova-compute[74882]:       <nova:owner>
Nov 21 14:45:11 user nova-compute[74882]:         <nova:user uuid="a0bd7642251d4e968bb108362dee3a3b">tempest-AttachVolumeShelveTestJSON-1109379350-project-member</nova:user>
Nov 21 14:45:11 user nova-compute[74882]:         <nova:project uuid="47eba7494a3b42929f2007ff8162d9bb">tempest-AttachVolumeShelveTestJSON-1109379350</nova:project>
Nov 21 14:45:11 user nova-compute[74882]:       </nova:owner>
Nov 21 14:45:11 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:45:11 user nova-compute[74882]:       <nova:ports>
Nov 21 14:45:11 user nova-compute[74882]:         <nova:port uuid="bc9aeb9b-ae63-4f22-89d4-25c6644afee8">
Nov 21 14:45:11 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 14:45:11 user nova-compute[74882]:         </nova:port>
Nov 21 14:45:11 user nova-compute[74882]:       </nova:ports>
Nov 21 14:45:11 user nova-compute[74882]:     </nova:instance>
Nov 21 14:45:11 user nova-compute[74882]:   </metadata>
Nov 21 14:45:11 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:45:11 user nova-compute[74882]:     <system>
Nov 21 14:45:11 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:45:11 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:45:11 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:45:11 user nova-compute[74882]:       <entry name="serial">3cf2345b-bb3d-4bab-a89a-ca50af5fd539</entry>
Nov 21 14:45:11 user nova-compute[74882]:       <entry name="uuid">3cf2345b-bb3d-4bab-a89a-ca50af5fd539</entry>
Nov 21 14:45:11 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:45:11 user nova-compute[74882]:     </system>
Nov 21 14:45:11 user nova-compute[74882]:   </sysinfo>
Nov 21 14:45:11 user nova-compute[74882]:   <os>
Nov 21 14:45:11 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:45:11 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:45:11 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:45:11 user nova-compute[74882]:   </os>
Nov 21 14:45:11 user nova-compute[74882]:   <features>
Nov 21 14:45:11 user nova-compute[74882]:     <acpi/>
Nov 21 14:45:11 user nova-compute[74882]:     <apic/>
Nov 21 14:45:11 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:45:11 user nova-compute[74882]:   </features>
Nov 21 14:45:11 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:45:11 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:45:11 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:45:11 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:45:11 user nova-compute[74882]:   </clock>
Nov 21 14:45:11 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:45:11 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:45:11 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:45:11 user nova-compute[74882]:   </cpu>
Nov 21 14:45:11 user nova-compute[74882]:   <devices>
Nov 21 14:45:11 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:45:11 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:45:11 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk"/>
Nov 21 14:45:11 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:45:11 user nova-compute[74882]:     </disk>
Nov 21 14:45:11 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:45:11 user nova-compute[74882]:       <mac address="fa:16:3e:f3:39:0f"/>
Nov 21 14:45:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:45:11 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:45:11 user nova-compute[74882]:       <target dev="tapbc9aeb9b-ae"/>
Nov 21 14:45:11 user nova-compute[74882]:     </interface>
Nov 21 14:45:11 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:45:11 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/console.log" append="off"/>
Nov 21 14:45:11 user nova-compute[74882]:     </serial>
Nov 21 14:45:11 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:45:11 user nova-compute[74882]:     <video>
Nov 21 14:45:11 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:45:11 user nova-compute[74882]:     </video>
Nov 21 14:45:11 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:45:11 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:45:11 user nova-compute[74882]:     </rng>
Nov 21 14:45:11 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:45:11 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:45:11 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:45:11 user nova-compute[74882]:     </memballoon>
Nov 21 14:45:11 user nova-compute[74882]:   </devices>
Nov 21 14:45:11 user nova-compute[74882]: </domain>
Nov 21 14:45:11 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-744304248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-744304248',id=43,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWSWM7hKRLSDhHNLt8+WbBMqDCHWTKHdi/qT5EvjhUmMORwEUFq8yP0AXHv5t4D2CKrfo4oSwn7TwNq1eJ0+LVIeelZCR9xZsBuHTuZi19lUSNdrfgNSdbgCudlVnYvrw==',key_name='tempest-keypair-1578555145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-8ibbq2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=3cf2345b-bb3d-4bab-a89a-ca50af5fd539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG os_vif [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b89ef2c9-3b91-5a6e-bb6f-36ca9b93a09f', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc9aeb9b-ae, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc9aeb9b-ae, col_values=(('qos', UUID('46e9f2dd-8a52-49cf-8bab-1be0a0aba5f3')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc9aeb9b-ae, col_values=(('external_ids', {'iface-id': 'bc9aeb9b-ae63-4f22-89d4-25c6644afee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:39:0f', 'vm-uuid': '3cf2345b-bb3d-4bab-a89a-ca50af5fd539'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:11 user nova-compute[74882]: INFO os_vif [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae')
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No VIF found with MAC fa:16:3e:f3:39:0f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updated VIF entry in instance network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG nova.network.neutron [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:45:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c923d415-c1c5-49e9-8325-7d6cd3df5595 req-bdf9f8a3-bfeb-4728-aaa1-16c49547a5a7 service nova] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:12 user nova-compute[74882]: INFO nova.compute.manager [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Terminating instance
Nov 21 14:45:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:45:13 user nova-compute[74882]: WARNING nova.compute.manager [req-d96ef46a-f31b-4b6c-a9e6-ce45de93886d req-93c41b33-e237-4be5-9382-4b91b1716e53 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state building and task_state spawning.
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-unplugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-unplugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-unplugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Acquiring lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] No waiting events found dispatching network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:45:13 user nova-compute[74882]: WARNING nova.compute.manager [req-21e87c51-59ba-487c-86c2-1f4e7c07e738 req-b5ac77ff-f3b9-4654-a54f-be6d9139d113 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received unexpected event network-vif-plugged-2076301e-56e7-4d67-90db-192335b0f56c for instance with vm_state rescued and task_state deleting.
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Instance destroyed successfully.
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'resources' on Instance uuid ebf25b5a-9531-4058-8e86-372fef1517e0 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-71590957',display_name='tempest-ServerRescueNegativeTestJSON-server-71590957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-71590957',id=29,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:31:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-5kn0lgrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:31:05Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=ebf25b5a-9531-4058-8e86-372fef1517e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "2076301e-56e7-4d67-90db-192335b0f56c", "address": "fa:16:3e:bc:e3:29", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076301e-56", "ovs_interfaceid": "2076301e-56e7-4d67-90db-192335b0f56c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG os_vif [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2076301e-56, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b24098a-18e5-4245-9524-41d4afe95007) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:13 user nova-compute[74882]: INFO os_vif [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=2076301e-56e7-4d67-90db-192335b0f56c,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076301e-56')
Nov 21 14:45:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Deleting instance files /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0_del
Nov 21 14:45:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Deletion of /opt/stack/data/nova/instances/ebf25b5a-9531-4058-8e86-372fef1517e0_del complete
Nov 21 14:45:13 user nova-compute[74882]: INFO nova.compute.manager [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 21 14:45:13 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:45:13 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:45:14 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:45:14 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Took 0.41 seconds to deallocate network for instance.
Nov 21 14:45:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:14 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:45:14 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:45:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:14 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Deleted allocations for instance ebf25b5a-9531-4058-8e86-372fef1517e0
Nov 21 14:45:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a3075b2d-a3de-44d9-9448-2754c6446e58 tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "ebf25b5a-9531-4058-8e86-372fef1517e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:45:15 user nova-compute[74882]: WARNING nova.compute.manager [req-aa55c69b-7d5d-4c68-8251-0526f0afb300 req-573246d7-d40b-4cce-8bc6-42ac3ec50e86 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state building and task_state spawning.
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-8f822539-428f-42a3-a00d-83d151b17b6a req-2ac6e7cc-de5c-42f1-a545-675f6db1cdf6 service nova] [instance: ebf25b5a-9531-4058-8e86-372fef1517e0] Received event network-vif-deleted-2076301e-56e7-4d67-90db-192335b0f56c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:45:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance spawned successfully.
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:45:15 user nova-compute[74882]: INFO nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 21 14:45:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:45:15 user nova-compute[74882]: INFO nova.compute.manager [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Took 6.62 seconds to build instance.
Nov 21 14:45:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1cc8aa80-1c99-4ea8-bf56-1035a5937f88 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.713s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:45:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:45:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:45:50 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:45:50 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=25.152729034423828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:45:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:45:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:45:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:45:56 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:45:57 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [{"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:45:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-8f8ecb76-9606-4119-a5e6-53fe33413b0c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:45:57 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:45:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:45:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:03 user nova-compute[74882]: INFO nova.compute.manager [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Terminating instance
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c139c2c-486d-445f-a7be-423e632acd51 req-3cad4a54-b12b-4a2a-913b-dcbbf1598305 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-unplugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Instance destroyed successfully.
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lazy-loading 'resources' on Instance uuid 8f8ecb76-9606-4119-a5e6-53fe33413b0c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:29:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175800306',display_name='tempest-ServerRescueNegativeTestJSON-server-175800306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175800306',id=28,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:33:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50c445b6ade47c09380da2248cf5954',ramdisk_id='',reservation_id='r-6t5y3swy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2007417611',owner_user_name='tempest-ServerRescueNegativeTestJSON-2007417611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:35:49Z,user_data=None,user_id='4b8ebb88fee544a793fd71ebeee0845f',uuid=8f8ecb76-9606-4119-a5e6-53fe33413b0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converting VIF {"id": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "address": "fa:16:3e:6b:07:97", "network": {"id": "758c2446-6e4b-4069-b657-f62d55115a7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2002050264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50c445b6ade47c09380da2248cf5954", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e015b80-8a", "ovs_interfaceid": "1e015b80-8ab0-446f-aebd-541aaae71b0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG os_vif [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e015b80-8a, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fefc381-abfd-473e-b1cd-1f1c98540922) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:46:03 user nova-compute[74882]: INFO os_vif [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:07:97,bridge_name='br-int',has_traffic_filtering=True,id=1e015b80-8ab0-446f-aebd-541aaae71b0f,network=Network(758c2446-6e4b-4069-b657-f62d55115a7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e015b80-8a')
Nov 21 14:46:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Deleting instance files /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c_del
Nov 21 14:46:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Deletion of /opt/stack/data/nova/instances/8f8ecb76-9606-4119-a5e6-53fe33413b0c_del complete
Nov 21 14:46:03 user nova-compute[74882]: INFO nova.compute.manager [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 21 14:46:03 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:46:03 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:46:04 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:46:04 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Took 0.38 seconds to deallocate network for instance.
Nov 21 14:46:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-deleted-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:46:04 user nova-compute[74882]: INFO nova.compute.manager [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Neutron deleted interface 1e015b80-8ab0-446f-aebd-541aaae71b0f; detaching it from the instance and deleting it from the info cache
Nov 21 14:46:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:46:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-8b456404-8efa-4821-b4b0-485e59fdb043 req-205b304f-3c47-439d-b149-e843c17b41c9 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Detach interface failed, port_id=1e015b80-8ab0-446f-aebd-541aaae71b0f, reason: Instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c could not be found. {{(pid=74882) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 21 14:46:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:04 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:46:04 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:46:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:04 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Deleted allocations for instance 8f8ecb76-9606-4119-a5e6-53fe33413b0c
Nov 21 14:46:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ce75b709-1af4-4f7e-85ed-2041aea16f7f tempest-ServerRescueNegativeTestJSON-2007417611 tempest-ServerRescueNegativeTestJSON-2007417611-project-member] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.429s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:46:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Acquiring lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] Lock "8f8ecb76-9606-4119-a5e6-53fe33413b0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] No waiting events found dispatching network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:46:05 user nova-compute[74882]: WARNING nova.compute.manager [req-0a6e404a-ca9c-4ec6-ae69-5f066decc750 req-75013fd1-d234-4844-bd65-d7207464fe92 service nova] [instance: 8f8ecb76-9606-4119-a5e6-53fe33413b0c] Received unexpected event network-vif-plugged-1e015b80-8ab0-446f-aebd-541aaae71b0f for instance with vm_state deleted and task_state None.
Nov 21 14:46:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:46:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:46:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:46:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:46:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:46:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:46:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:46:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:46:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:46:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:46:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG nova.objects.instance [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'flavor' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:36 user nova-compute[74882]: INFO nova.compute.manager [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Attaching volume 1d5fbba4-7b74-466e-a418-04fc7576669e to /dev/vdb
Nov 21 14:46:36 user nova-compute[74882]: DEBUG os_brick.utils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf208e1-97f7-40bc-ad3d-2718b0de640b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ebb7cc-d1dc-45ad-8a52-da02c8fd5989]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[96197142-985b-4624-bb2a-a2bfc3bd7837]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe2b18-09f9-4ff2-9486-b0df63665e77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:46:36 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:46:36 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e34929-ea60-4b0c-a1c8-8123ad80a91b]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG os_brick.utils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:46:36 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating existing volume attachment record: fb923393-f5b5-4539-af71-f3ab79ef03a5 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:46:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPdEmkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:46:42 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:46:42 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:46:42 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc96534-6b28-411d-a00d-734b7a3880ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:46:42 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8661ac-183e-45b5-af7c-cc7bdf6e3857]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e] added
Nov 21 14:46:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6508e431-d1b3-4767-ada5-d8a6c7331aa2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac2f426-5462-482f-be69-8a52a8a141bc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFPdEmkl {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFPdEmkl" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747b2e2-0a01-4516-9b6c-129b823f00f7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFPdEmkl'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7283e38c-13ab-4e8d-b458-1c391655e714]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[445cc057-484f-4e9e-ac32-deb29b958a07]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:46:42 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:46:42 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:46:42 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 14:46:42 user nova-compute[74882]: 
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[152b52dd-627d-47f4-815d-eeaa347cf0b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260]
Nov 21 14:46:42 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260] successful.
Nov 21 14:46:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b5c816-ff7f-4334-a851-5fd6a669e44c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb23d0-1ecc-454c-a7c1-aaeba4fc2fa9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)
Nov 21 14:46:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)
Nov 21 14:46:42 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472f7b2-39eb-4e96-b81b-4230b4142ac6]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:42 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPdEmkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '23434376164313231', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434376164313231', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG nova.objects.instance [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'flavor' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:43 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:46:43 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:46:43 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:46:43 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:46:43 user nova-compute[74882]:   <serial>1d5fbba4-7b74-466e-a418-04fc7576669e</serial>
Nov 21 14:46:43 user nova-compute[74882]: </disk>
Nov 21 14:46:43 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:46:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:46:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:46:44 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No VIF found with MAC fa:16:3e:46:36:47, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:46:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-09f80455-099e-467a-81d8-a0ce652f47bf tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.951s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:45 user nova-compute[74882]: INFO nova.compute.manager [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Rescuing
Nov 21 14:46:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:46:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:46:45 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:46:45 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:46:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:46:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG nova.compute.manager [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:46:46 user nova-compute[74882]: WARNING nova.compute.manager [req-d2cfcd35-3edc-4be6-8fbb-9814a6a1d1a4 req-f7b7f4cb-dcc7-4fe8-8409-d7ff54f66b98 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state active and task_state rescuing.
Nov 21 14:46:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance destroyed successfully.
Nov 21 14:46:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Attempting a stable device rescue
Nov 21 14:46:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74882) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance directory exists: not creating {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 21 14:46:46 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Creating image(s)
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "edd46a4415f4556c8756f41482181fcd314adefc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "edd46a4415f4556c8756f41482181fcd314adefc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG nova.virt.images [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] fe09c065-b11f-42ae-8da0-38f1328ac27e was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.part /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:46:48 user nova-compute[74882]: WARNING nova.compute.manager [req-6fbe46a9-ad81-419b-86e3-4c8cfc2f6bc6 req-6dad0722-87e3-414b-8f1e-4fe9a9a7519e service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state active and task_state rescuing.
Nov 21 14:46:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.part /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.converted" returned: 0 in 0.715s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:48 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "edd46a4415f4556c8756f41482181fcd314adefc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.385s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "edd46a4415f4556c8756f41482181fcd314adefc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "edd46a4415f4556c8756f41482181fcd314adefc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc,backing_fmt=raw /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc,backing_fmt=raw /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue" returned: 0 in 0.051s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "edd46a4415f4556c8756f41482181fcd314adefc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'migration_context' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Object Instance<2be9dfed-8102-4797-9d47-13041ed0a4ef> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Start _get_guest_xml network_info=[{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "vif_mac": "fa:16:3e:46:36:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fe09c065-b11f-42ae-8da0-38f1328ac27e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPdEmkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2be9dfed-8102-4797-9d47-13041ed0a4ef', 'attached_at': '', 'detached_at': '', 'volume_id': '1d5fbba4-7b74-466e-a418-04fc7576669e', 'serial': '1d5fbba4-7b74-466e-a418-04fc7576669e'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'fb923393-f5b5-4539-af71-f3ab79ef03a5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'resources' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Object Instance<2be9dfed-8102-4797-9d47-13041ed0a4ef> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'numa_topology' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Object Instance<2be9dfed-8102-4797-9d47-13041ed0a4ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:46:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:46:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Object Instance<2be9dfed-8102-4797-9d47-13041ed0a4ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPdEmkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:46:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:46:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:46:49 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c624bec-2dd2-4a72-8c77-ba26e187a9b1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VFPdEmkl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 21 14:46:49 user nova-compute[74882]: node.name = iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e
Nov 21 14:46:49 user nova-compute[74882]: node.tpgt = -1
Nov 21 14:46:49 user nova-compute[74882]: node.startup = automatic
Nov 21 14:46:49 user nova-compute[74882]: node.leading_login = No
Nov 21 14:46:49 user nova-compute[74882]: iface.iscsi_ifacename = default
Nov 21 14:46:49 user nova-compute[74882]: iface.net_ifacename = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.ipaddress = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.prefix_len = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.hwaddress = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.transport_name = tcp
Nov 21 14:46:49 user nova-compute[74882]: iface.initiatorname = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.state = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.vlan_id = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.vlan_priority = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.vlan_state = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.iface_num = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.mtu = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.port = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.bootproto = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.subnet_mask = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.gateway = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_alt_client_id_state = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_alt_client_id = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_dns = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_learn_iqn = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_req_vendor_id_state = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_vendor_id_state = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_vendor_id = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.dhcp_slp_da = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.fragmentation = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.gratuitous_arp = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.incoming_forwarding = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.tos_state = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.tos = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.ttl = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.delayed_ack = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.tcp_nagle = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.tcp_wsf_state = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.tcp_wsf = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.tcp_timer_scale = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.tcp_timestamp = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.redirect = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.def_task_mgmt_timeout = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.header_digest = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.data_digest = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.immediate_data = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.initial_r2t = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.data_seq_inorder = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.data_pdu_inorder = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.erl = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.max_receive_data_len = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.first_burst_len = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.max_outstanding_r2t = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.max_burst_len = 0
Nov 21 14:46:49 user nova-compute[74882]: iface.chap_auth = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.bidi_chap = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.strict_login_compliance = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.discovery_auth = <empty>
Nov 21 14:46:49 user nova-compute[74882]: iface.discovery_logout = <empty>
Nov 21 14:46:49 user nova-compute[74882]: node.discovery_address = <empty>
Nov 21 14:46:49 user nova-compute[74882]: node.discovery_port = 0
Nov 21 14:46:49 user nova-compute[74882]: node.discovery_type = static
Nov 21 14:46:49 user nova-compute[74882]: node.session.initial_cmdsn = 0
Nov 21 14:46:49 user nova-compute[74882]: node.session.initial_login_retry_max = 8
Nov 21 14:46:49 user nova-compute[74882]: node.session.xmit_thread_priority = -20
Nov 21 14:46:49 user nova-compute[74882]: node.session.cmds_max = 128
Nov 21 14:46:49 user nova-compute[74882]: node.session.queue_depth = 32
Nov 21 14:46:49 user nova-compute[74882]: node.session.nr_sessions = 1
Nov 21 14:46:49 user nova-compute[74882]: node.session.auth.authmethod = CHAP
Nov 21 14:46:49 user nova-compute[74882]: node.session.auth.username = VFPdEmkl
Nov 21 14:46:49 user nova-compute[74882]: node.session.auth.password = ***
Nov 21 14:46:49 user nova-compute[74882]: node.session.auth.username_in = <empty>
Nov 21 14:46:49 user nova-compute[74882]: node.session.auth.password_in = <empty>
Nov 21 14:46:49 user nova-compute[74882]: node.session.auth.chap_algs = MD5
Nov 21 14:46:49 user nova-compute[74882]: node.session.timeo.replacement_timeout = 120
Nov 21 14:46:49 user nova-compute[74882]: node.session.err_timeo.abort_timeout = 15
Nov 21 14:46:49 user nova-compute[74882]: node.session.err_timeo.lu_reset_timeout = 30
Nov 21 14:46:49 user nova-compute[74882]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 21 14:46:49 user nova-compute[74882]: node.session.err_timeo.host_reset_timeout = 60
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.FastAbort = Yes
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.InitialR2T = No
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.ImmediateData = Yes
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.FirstBurstLength = 262144
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.MaxBurstLength = 16776192
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.DefaultTime2Retain = 0
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.DefaultTime2Wait = 2
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.MaxConnections = 1
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 21 14:46:49 user nova-compute[74882]: node.session.iscsi.ERL = 0
Nov 21 14:46:49 user nova-compute[74882]: node.session.scan = manual
Nov 21 14:46:49 user nova-compute[74882]: node.session.reopen_max = 0
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].address = 172.16.0.220
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].port = 3260
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].startup = manual
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].tcp.window_size = 524288
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].tcp.type_of_service = 0
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].timeo.logout_timeout = 15
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].timeo.login_timeout = 15
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].timeo.auth_timeout = 45
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].timeo.noop_out_interval = 5
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].timeo.noop_out_timeout = 5
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].iscsi.HeaderDigest = None
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].iscsi.DataDigest = None
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].iscsi.IFMarker = No
Nov 21 14:46:49 user nova-compute[74882]: node.conn[0].iscsi.OFMarker = No
Nov 21 14:46:49 user nova-compute[74882]: # END RECORD
Nov 21 14:46:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4f681-b655-4f82-a240-fb951dae52d2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c5e65-467c-4e4c-9cdc-20b01aa1f764]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFPdEmkl {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFPdEmkl" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e9a755-4f67-4398-82ae-7e6b5d46ec3f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFPdEmkl'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f32c8-6789-483f-b8ad-5428ac10994a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861ea3d-3d5b-47a5-a1d7-2ada8ddb27df]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)
Nov 21 14:46:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)
Nov 21 14:46:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.119s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] HCTL ('33', '0', '0', 0) found on session 52 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfc0130-7c06-4a67-8cd8-3ca74e8b46f8]: (4, ('0 0 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Searching for a device in session 52 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPdEmkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.141s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] <== connect_volume: return (143ms) {'type': 'block', 'scsi_wwn': '23434376164313231', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434376164313231', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-133109328',display_name='tempest-ServerStableDeviceRescueTest-server-133109328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-133109328',id=42,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHNmtipo1wU5OMs2w2xiTJOR6qMSY/j0Cp9ebE0YDGN2Tt3kxaT2nhewhyeEiRj0ugTAPd8QBkOGXJIMLvcE7YmsWU9Xk4fM78Vj52XJL9sQFqG1gb6MIB0acIEKHcZg==',key_name='tempest-keypair-1394726022',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:42:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35cfaa913094e829acc68857bba4d55',ramdisk_id='',reservation_id='r-rm0rskwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-218360850',owner_user_name='tempest-ServerStableDeviceRescueTest-218360850-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6dc4469b07049be829644dfecf5745e',uuid=2be9dfed-8102-4797-9d47-13041ed0a4ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "vif_mac": "fa:16:3e:46:36:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converting VIF {"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "vif_mac": "fa:16:3e:46:36:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'pci_devices' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.objects.base [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Object Instance<2be9dfed-8102-4797-9d47-13041ed0a4ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:46:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:46:49 user nova-compute[74882]:   <uuid>2be9dfed-8102-4797-9d47-13041ed0a4ef</uuid>
Nov 21 14:46:49 user nova-compute[74882]:   <name>instance-0000002a</name>
Nov 21 14:46:49 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:46:49 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:46:49 user nova-compute[74882]:   <metadata>
Nov 21 14:46:49 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:46:49 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:46:49 user nova-compute[74882]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-133109328</nova:name>
Nov 21 14:46:49 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:46:49</nova:creationTime>
Nov 21 14:46:49 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:46:49 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:46:49 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:46:49 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:46:49 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:46:49 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:46:49 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:46:49 user nova-compute[74882]:       <nova:owner>
Nov 21 14:46:49 user nova-compute[74882]:         <nova:user uuid="b6dc4469b07049be829644dfecf5745e">tempest-ServerStableDeviceRescueTest-218360850-project-member</nova:user>
Nov 21 14:46:49 user nova-compute[74882]:         <nova:project uuid="c35cfaa913094e829acc68857bba4d55">tempest-ServerStableDeviceRescueTest-218360850</nova:project>
Nov 21 14:46:49 user nova-compute[74882]:       </nova:owner>
Nov 21 14:46:49 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 14:46:49 user nova-compute[74882]:       <nova:ports>
Nov 21 14:46:49 user nova-compute[74882]:         <nova:port uuid="9c201a78-a3ad-4da1-9620-26544a9493b9">
Nov 21 14:46:49 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:46:49 user nova-compute[74882]:         </nova:port>
Nov 21 14:46:49 user nova-compute[74882]:       </nova:ports>
Nov 21 14:46:49 user nova-compute[74882]:     </nova:instance>
Nov 21 14:46:49 user nova-compute[74882]:   </metadata>
Nov 21 14:46:49 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:46:49 user nova-compute[74882]:     <system>
Nov 21 14:46:49 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:46:49 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:46:49 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:46:49 user nova-compute[74882]:       <entry name="serial">2be9dfed-8102-4797-9d47-13041ed0a4ef</entry>
Nov 21 14:46:49 user nova-compute[74882]:       <entry name="uuid">2be9dfed-8102-4797-9d47-13041ed0a4ef</entry>
Nov 21 14:46:49 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:46:49 user nova-compute[74882]:     </system>
Nov 21 14:46:49 user nova-compute[74882]:   </sysinfo>
Nov 21 14:46:49 user nova-compute[74882]:   <os>
Nov 21 14:46:49 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:46:49 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:46:49 user nova-compute[74882]:   </os>
Nov 21 14:46:49 user nova-compute[74882]:   <features>
Nov 21 14:46:49 user nova-compute[74882]:     <acpi/>
Nov 21 14:46:49 user nova-compute[74882]:     <apic/>
Nov 21 14:46:49 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:46:49 user nova-compute[74882]:   </features>
Nov 21 14:46:49 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:46:49 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:46:49 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:46:49 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:46:49 user nova-compute[74882]:   </clock>
Nov 21 14:46:49 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:46:49 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:46:49 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:46:49 user nova-compute[74882]:   </cpu>
Nov 21 14:46:49 user nova-compute[74882]:   <devices>
Nov 21 14:46:49 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:46:49 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:46:49 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk"/>
Nov 21 14:46:49 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:46:49 user nova-compute[74882]:     </disk>
Nov 21 14:46:49 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:46:49 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:46:49 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:46:49 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:46:49 user nova-compute[74882]:       <serial>1d5fbba4-7b74-466e-a418-04fc7576669e</serial>
Nov 21 14:46:49 user nova-compute[74882]:     </disk>
Nov 21 14:46:49 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:46:49 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:46:49 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue"/>
Nov 21 14:46:49 user nova-compute[74882]:       <target dev="vdc" bus="virtio"/>
Nov 21 14:46:49 user nova-compute[74882]:       <boot order="1"/>
Nov 21 14:46:49 user nova-compute[74882]:     </disk>
Nov 21 14:46:49 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:46:49 user nova-compute[74882]:       <mac address="fa:16:3e:46:36:47"/>
Nov 21 14:46:49 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:46:49 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:46:49 user nova-compute[74882]:       <target dev="tap9c201a78-a3"/>
Nov 21 14:46:49 user nova-compute[74882]:     </interface>
Nov 21 14:46:49 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:46:49 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/console.log" append="off"/>
Nov 21 14:46:49 user nova-compute[74882]:     </serial>
Nov 21 14:46:49 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:46:49 user nova-compute[74882]:     <video>
Nov 21 14:46:49 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:46:49 user nova-compute[74882]:     </video>
Nov 21 14:46:49 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:46:49 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:46:49 user nova-compute[74882]:     </rng>
Nov 21 14:46:49 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:46:49 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:46:49 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:46:49 user nova-compute[74882]:     </memballoon>
Nov 21 14:46:49 user nova-compute[74882]:   </devices>
Nov 21 14:46:49 user nova-compute[74882]: </domain>
Nov 21 14:46:49 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:46:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance destroyed successfully.
Nov 21 14:46:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] No VIF found with MAC fa:16:3e:46:36:47, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:50 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:46:51 user nova-compute[74882]: WARNING nova.compute.manager [req-69c93a84-a35c-4593-8e82-5407c71e9413 req-869a6ae4-906e-488b-8d93-d4435197e7f3 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state active and task_state rescuing.
Nov 21 14:46:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:46:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:53 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:46:53 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=25.08545684814453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ae6c338d-1528-4525-9028-372160b72001 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:46:53 user nova-compute[74882]: WARNING nova.compute.manager [req-b355153b-069e-43eb-a26d-f8de69d3eaef req-5ab0976e-ce71-4b8d-a495-7e511c5d8378 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state active and task_state rescuing.
Nov 21 14:46:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:46:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:46:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:57 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:46:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:46:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:46:57 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:46:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:46:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:46:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:46:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:46:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:46:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing instance network info cache due to event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updated VIF entry in instance network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:47:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6cd0f51d-6a2c-4f86-b792-e7a93ab42fd7 req-fd0f2451-b7dc-44e0-a1a0-110412cca4e1 service nova] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:47:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:47:04 user nova-compute[74882]: INFO nova.compute.manager [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Shelving
Nov 21 14:47:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:47:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:47:04 user nova-compute[74882]: WARNING nova.compute.manager [req-d5a21ab1-006d-42d9-9f9e-b21251e77aac req-aee7612a-d969-4ce7-b6ba-5f4b5a11ba67 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state active and task_state shelving.
Nov 21 14:47:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance destroyed successfully.
Nov 21 14:47:04 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Beginning cold snapshot process
Nov 21 14:47:05 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:47:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk /opt/stack/data/nova/instances/snapshots/tmp3b4wt65a/ec4211deaf844c98b2276ad379813cb8 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:47:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk /opt/stack/data/nova/instances/snapshots/tmp3b4wt65a/ec4211deaf844c98b2276ad379813cb8" returned: 0 in 0.412s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:47:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Snapshot extracted, beginning image upload
Nov 21 14:47:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:47:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:47:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:47:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:47:06 user nova-compute[74882]: DEBUG nova.compute.manager [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:47:06 user nova-compute[74882]: WARNING nova.compute.manager [req-66f1c2bc-6cdd-4da1-991c-f58758cd3ffa req-78a811a8-2c86-46e7-bf59-dce792fba521 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state active and task_state shelving_image_uploading.
Nov 21 14:47:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:08 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Snapshot image upload complete
Nov 21 14:47:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:47:08 user nova-compute[74882]: INFO nova.compute.manager [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Shelve offloading
Nov 21 14:47:08 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance destroyed successfully.
Nov 21 14:47:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:47:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:47:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:47:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:47:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:47:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:47:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance destroyed successfully.
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.objects.instance [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'resources' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-744304248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-744304248',id=43,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWSWM7hKRLSDhHNLt8+WbBMqDCHWTKHdi/qT5EvjhUmMORwEUFq8yP0AXHv5t4D2CKrfo4oSwn7TwNq1eJ0+LVIeelZCR9xZsBuHTuZi19lUSNdrfgNSdbgCudlVnYvrw==',key_name='tempest-keypair-1578555145',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-8ibbq2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member',shelved_at='2023-11-21T14:47:08.117832',shelved_host='user',shelved_image_id='33fc596b-5cbe-4c85-a3fa-49ebc5d28553'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:47:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=3cf2345b-bb3d-4bab-a89a-ca50af5fd539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG os_vif [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc9aeb9b-ae, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46e9f2dd-8a52-49cf-8bab-1be0a0aba5f3) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.compute.manager [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing instance network info cache due to event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:47:09 user nova-compute[74882]: INFO os_vif [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae')
Nov 21 14:47:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Deleting instance files /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539_del
Nov 21 14:47:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Deletion of /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539_del complete
Nov 21 14:47:09 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Deleted allocations for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539
Nov 21 14:47:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.objects.instance [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.objects.base [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<3cf2345b-bb3d-4bab-a89a-ca50af5fd539> lazy-loaded attributes: resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-072cc31a-b83f-493e-a0da-bf9434bda126 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.808s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updated VIF entry in instance network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG nova.network.neutron [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:47:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-563c0319-896c-428e-85b4-1cb219370d13 req-20233e98-e6f0-4fd8-a03a-39ee2277b030 service nova] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:47:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:47:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:47:52 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:47:53 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:47:53 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.044090270996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:47:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:47:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:55 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:47:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:47:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:47:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 21 14:47:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:47:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:47:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:48:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:36 user nova-compute[74882]: INFO nova.compute.manager [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Unrescuing
Nov 21 14:48:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:48:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:48:36 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG nova.network.neutron [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG nova.objects.instance [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'flavor' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:48:37 user nova-compute[74882]: WARNING nova.compute.manager [req-bcbb695d-8fa7-4397-9c6a-2116d44c9912 req-4d9661fb-e139-4c2a-9608-751d9c274459 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:48:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing instance network info cache due to event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG nova.network.neutron [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:48:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance destroyed successfully.
Nov 21 14:48:38 user nova-compute[74882]: DEBUG nova.network.neutron [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updated VIF entry in instance network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:48:38 user nova-compute[74882]: DEBUG nova.network.neutron [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:48:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6e2df139-1158-4791-b677-9a20c0c4aee0 req-ce78fc54-8d1e-4ae5-b72c-b1c863a3fcd8 service nova] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:48:39 user nova-compute[74882]: WARNING nova.compute.manager [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:48:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:48:39 user nova-compute[74882]: WARNING nova.compute.manager [req-75263986-4fdd-4ea3-a2cb-3e62329535dc req-7d94b20e-b3b5-46ba-b620-f0fc8f7ce301 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state rescued and task_state unrescuing.
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing instance network info cache due to event network-changed-9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:48:39 user nova-compute[74882]: DEBUG nova.network.neutron [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Refreshing network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:48:40 user nova-compute[74882]: DEBUG nova.network.neutron [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updated VIF entry in instance network info cache for port 9c201a78-a3ad-4da1-9620-26544a9493b9. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:48:40 user nova-compute[74882]: DEBUG nova.network.neutron [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:48:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8d21c743-21a2-4261-8427-7c775175af2c req-1d783cd9-b616-4657-8e8e-1ad98899d529 service nova] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:48:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8796a0a4-3053-4fec-98c6-f6b2eae1d475 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:48:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:48:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:48:41 user nova-compute[74882]: WARNING nova.compute.manager [req-2b806c3d-0c54-44bc-8fef-c900e6a6c314 req-878c2ea0-bdc6-4487-bb5f-3195b96cd811 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state active and task_state None.
Nov 21 14:48:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:48:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:48:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:48:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.035953521728516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:48:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:56 user nova-compute[74882]: INFO nova.compute.manager [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Unshelving
Nov 21 14:48:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'pci_requests' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:48:57 user nova-compute[74882]: INFO nova.compute.claims [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Claim successful on node user
Nov 21 14:48:57 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:57 user nova-compute[74882]: INFO nova.network.neutron [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating port bc9aeb9b-ae63-4f22-89d4-25c6644afee8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing instance network info cache due to event network-changed-bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:48:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Creating image(s)
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.network.neutron [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Refreshing network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG nova.objects.base [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<3cf2345b-bb3d-4bab-a89a-ca50af5fd539> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "8394dfd7e80ec0d8e750f57dde0bbd397462a899" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:48:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "8394dfd7e80ec0d8e750f57dde0bbd397462a899" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:48:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:48:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.part --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG nova.virt.images [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] 33fc596b-5cbe-4c85-a3fa-49ebc5d28553 was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.part /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updated VIF entry in instance network info cache for port bc9aeb9b-ae63-4f22-89d4-25c6644afee8. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f1db794d-856e-47d5-a3aa-c7c151e691c7 req-71031619-6192-4db5-8780-632a584c5a08 service nova] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [{"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-2be9dfed-8102-4797-9d47-13041ed0a4ef" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.part /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.converted" returned: 0 in 0.563s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "8394dfd7e80ec0d8e750f57dde0bbd397462a899" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.138s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "8394dfd7e80ec0d8e750f57dde0bbd397462a899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "8394dfd7e80ec0d8e750f57dde0bbd397462a899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:49:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 --force-share --output=json" returned: 0 in 0.182s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899,backing_fmt=raw /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899,backing_fmt=raw /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk 1073741824" returned: 0 in 0.063s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "8394dfd7e80ec0d8e750f57dde0bbd397462a899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'migration_context' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG nova.objects.base [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<3cf2345b-bb3d-4bab-a89a-ca50af5fd539> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:49:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Rebasing disk image.
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d -F raw /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:02 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d -F raw /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk" returned: 0 in 2.597s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Start _get_guest_xml network_info=[{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e153c2762f664892dd4dd4ec4ccf3b1d',container_format='bare',created_at=2023-11-21T14:47:04Z,direct_url=<?>,disk_format='qcow2',id=33fc596b-5cbe-4c85-a3fa-49ebc5d28553,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-744304248-shelved',owner='47eba7494a3b42929f2007ff8162d9bb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-21T14:47:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:49:04 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:49:04 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e153c2762f664892dd4dd4ec4ccf3b1d',container_format='bare',created_at=2023-11-21T14:47:04Z,direct_url=<?>,disk_format='qcow2',id=33fc596b-5cbe-4c85-a3fa-49ebc5d28553,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-744304248-shelved',owner='47eba7494a3b42929f2007ff8162d9bb',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-21T14:47:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.objects.base [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<3cf2345b-bb3d-4bab-a89a-ca50af5fd539> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-744304248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-744304248',id=43,image_ref='33fc596b-5cbe-4c85-a3fa-49ebc5d28553',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1578555145',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-8ibbq2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member',shelved_at='2023-11-21T14:47:08.117832',shelved_host='user',shelved_image_id='33fc596b-5cbe-4c85-a3fa-49ebc5d28553'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=3cf2345b-bb3d-4bab-a89a-ca50af5fd539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.objects.base [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Object Instance<3cf2345b-bb3d-4bab-a89a-ca50af5fd539> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:49:04 user nova-compute[74882]:   <uuid>3cf2345b-bb3d-4bab-a89a-ca50af5fd539</uuid>
Nov 21 14:49:04 user nova-compute[74882]:   <name>instance-0000002b</name>
Nov 21 14:49:04 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:49:04 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:49:04 user nova-compute[74882]:   <metadata>
Nov 21 14:49:04 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:49:04 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:49:04 user nova-compute[74882]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-744304248</nova:name>
Nov 21 14:49:04 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:49:04</nova:creationTime>
Nov 21 14:49:04 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:49:04 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:49:04 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:49:04 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:49:04 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:49:04 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:49:04 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:49:04 user nova-compute[74882]:       <nova:owner>
Nov 21 14:49:04 user nova-compute[74882]:         <nova:user uuid="a0bd7642251d4e968bb108362dee3a3b">tempest-AttachVolumeShelveTestJSON-1109379350-project-member</nova:user>
Nov 21 14:49:04 user nova-compute[74882]:         <nova:project uuid="47eba7494a3b42929f2007ff8162d9bb">tempest-AttachVolumeShelveTestJSON-1109379350</nova:project>
Nov 21 14:49:04 user nova-compute[74882]:       </nova:owner>
Nov 21 14:49:04 user nova-compute[74882]:       <nova:root type="image" uuid="33fc596b-5cbe-4c85-a3fa-49ebc5d28553"/>
Nov 21 14:49:04 user nova-compute[74882]:       <nova:ports>
Nov 21 14:49:04 user nova-compute[74882]:         <nova:port uuid="bc9aeb9b-ae63-4f22-89d4-25c6644afee8">
Nov 21 14:49:04 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 14:49:04 user nova-compute[74882]:         </nova:port>
Nov 21 14:49:04 user nova-compute[74882]:       </nova:ports>
Nov 21 14:49:04 user nova-compute[74882]:     </nova:instance>
Nov 21 14:49:04 user nova-compute[74882]:   </metadata>
Nov 21 14:49:04 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:49:04 user nova-compute[74882]:     <system>
Nov 21 14:49:04 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:49:04 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:49:04 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:49:04 user nova-compute[74882]:       <entry name="serial">3cf2345b-bb3d-4bab-a89a-ca50af5fd539</entry>
Nov 21 14:49:04 user nova-compute[74882]:       <entry name="uuid">3cf2345b-bb3d-4bab-a89a-ca50af5fd539</entry>
Nov 21 14:49:04 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:49:04 user nova-compute[74882]:     </system>
Nov 21 14:49:04 user nova-compute[74882]:   </sysinfo>
Nov 21 14:49:04 user nova-compute[74882]:   <os>
Nov 21 14:49:04 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:49:04 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:49:04 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:49:04 user nova-compute[74882]:   </os>
Nov 21 14:49:04 user nova-compute[74882]:   <features>
Nov 21 14:49:04 user nova-compute[74882]:     <acpi/>
Nov 21 14:49:04 user nova-compute[74882]:     <apic/>
Nov 21 14:49:04 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:49:04 user nova-compute[74882]:   </features>
Nov 21 14:49:04 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:49:04 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:49:04 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:49:04 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:49:04 user nova-compute[74882]:   </clock>
Nov 21 14:49:04 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:49:04 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:49:04 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:49:04 user nova-compute[74882]:   </cpu>
Nov 21 14:49:04 user nova-compute[74882]:   <devices>
Nov 21 14:49:04 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:49:04 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:49:04 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk"/>
Nov 21 14:49:04 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:49:04 user nova-compute[74882]:     </disk>
Nov 21 14:49:04 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:49:04 user nova-compute[74882]:       <mac address="fa:16:3e:f3:39:0f"/>
Nov 21 14:49:04 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:49:04 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:49:04 user nova-compute[74882]:       <target dev="tapbc9aeb9b-ae"/>
Nov 21 14:49:04 user nova-compute[74882]:     </interface>
Nov 21 14:49:04 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:49:04 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/console.log" append="off"/>
Nov 21 14:49:04 user nova-compute[74882]:     </serial>
Nov 21 14:49:04 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:49:04 user nova-compute[74882]:     <video>
Nov 21 14:49:04 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:49:04 user nova-compute[74882]:     </video>
Nov 21 14:49:04 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:49:04 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:49:04 user nova-compute[74882]:     </rng>
Nov 21 14:49:04 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:49:04 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:49:04 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:49:04 user nova-compute[74882]:     </memballoon>
Nov 21 14:49:04 user nova-compute[74882]:   </devices>
Nov 21 14:49:04 user nova-compute[74882]: </domain>
Nov 21 14:49:04 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-744304248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-744304248',id=43,image_ref='33fc596b-5cbe-4c85-a3fa-49ebc5d28553',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1578555145',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-8ibbq2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member',shelved_at='2023-11-21T14:47:08.117832',shelved_host='user',shelved_image_id='33fc596b-5cbe-4c85-a3fa-49ebc5d28553'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:48:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=3cf2345b-bb3d-4bab-a89a-ca50af5fd539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG os_vif [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b89ef2c9-3b91-5a6e-bb6f-36ca9b93a09f', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc9aeb9b-ae, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc9aeb9b-ae, col_values=(('qos', UUID('6d64904c-af42-4bdc-9bf3-f9e26099e1f9')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc9aeb9b-ae, col_values=(('external_ids', {'iface-id': 'bc9aeb9b-ae63-4f22-89d4-25c6644afee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:39:0f', 'vm-uuid': '3cf2345b-bb3d-4bab-a89a-ca50af5fd539'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:04 user nova-compute[74882]: INFO os_vif [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae')
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:49:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] No VIF found with MAC fa:16:3e:f3:39:0f, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:49:05 user nova-compute[74882]: WARNING nova.compute.manager [req-8c920d14-9b16-4ed5-a4bc-0b76c2fab216 req-e9b228a3-748f-4e00-9ac9-b3e464c10532 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 21 14:49:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:49:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:49:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:49:07 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:49:07 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance spawned successfully.
Nov 21 14:49:07 user nova-compute[74882]: DEBUG nova.compute.manager [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:49:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:49:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:49:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:07 user nova-compute[74882]: DEBUG nova.compute.manager [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:49:07 user nova-compute[74882]: WARNING nova.compute.manager [req-954a8e3e-24a5-4fa9-be14-c3f539630460 req-b27588f4-0233-4198-ae56-e96443dbe723 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 21 14:49:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:49:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4d0f810e-e2a7-41ee-bc3e-48ebe18bd914 tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.068s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:49:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:49:09 user nova-compute[74882]: INFO nova.compute.manager [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Detaching volume 1d5fbba4-7b74-466e-a418-04fc7576669e
Nov 21 14:49:09 user nova-compute[74882]: INFO nova.virt.block_device [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Attempting to driver detach volume 1d5fbba4-7b74-466e-a418-04fc7576669e from mountpoint /dev/vdb
Nov 21 14:49:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Attempting to detach device vdb from instance 2be9dfed-8102-4797-9d47-13041ed0a4ef from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:49:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:49:09 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:49:09 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:49:09 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:49:09 user nova-compute[74882]:   <serial>1d5fbba4-7b74-466e-a418-04fc7576669e</serial>
Nov 21 14:49:09 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:49:09 user nova-compute[74882]: </disk>
Nov 21 14:49:09 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:49:09 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Successfully detached device vdb from instance 2be9dfed-8102-4797-9d47-13041ed0a4ef from the persistent domain config.
Nov 21 14:49:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2be9dfed-8102-4797-9d47-13041ed0a4ef from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:49:09 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:49:09 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:49:09 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:49:09 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:49:09 user nova-compute[74882]:   <serial>1d5fbba4-7b74-466e-a418-04fc7576669e</serial>
Nov 21 14:49:09 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 14:49:09 user nova-compute[74882]: </disk>
Nov 21 14:49:09 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:49:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:49:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:49:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:30 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2be9dfed-8102-4797-9d47-13041ed0a4ef is timed out.
Nov 21 14:49:30 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Successfully detached device vdb from instance 2be9dfed-8102-4797-9d47-13041ed0a4ef from the live domain config.
Nov 21 14:49:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPdEmkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:49:30 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3bb08-a0df-4781-ad78-2bc61f37c30e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:49:30 user nova-compute[74882]: No targets found.
Nov 21 14:49:30 user nova-compute[74882]: iSNS:
Nov 21 14:49:30 user nova-compute[74882]: No targets found.
Nov 21 14:49:30 user nova-compute[74882]: STATIC:
Nov 21 14:49:30 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e
Nov 21 14:49:30 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:49:30 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:49:30 user nova-compute[74882]: FIRMWARE:
Nov 21 14:49:30 user nova-compute[74882]: No targets found.
Nov 21 14:49:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:49:30 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:49:30 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfff4dc-67b3-4159-8f72-fea4e349356d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b9279-5dc4-450b-8fd8-7b345a7f68e6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)
Nov 21 14:49:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e (non-flash)
Nov 21 14:49:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c657760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb2145b-38a2-4856-aeaf-5d2ac86d4f7c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fd0264-fe0e-41e9-878e-74b857242174]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f7e917-1d02-4190-8636-bf4906a1cb15]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2be68d-2753-4016-9f15-0861185c0f00]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe6011c-cd07-4e17-9b7d-d4e706cdf2dc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcebf6a-f0f9-4d6e-81ae-70c667fe284d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260]
Nov 21 14:49:30 user nova-compute[74882]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e, portal: 172.16.0.220,3260] successful.
Nov 21 14:49:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d5fbba4-7b74-466e-a418-04fc7576669e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb579af2-81c8-42aa-9854-109d786160d5]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] <== disconnect_volume: return (266ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:49:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:49:31 user nova-compute[74882]: DEBUG nova.objects.instance [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'flavor' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:49:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8009e23d-c0c0-42ec-b50d-6e4148065192 tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:49:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:49:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:54 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:49:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:49:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:49:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:49:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.00937271118164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:49:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:49:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2be9dfed-8102-4797-9d47-13041ed0a4ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:49:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:49:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:49:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:49:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:49:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:49:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:49:59 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [{"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-3cf2345b-bb3d-4bab-a89a-ca50af5fd539" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:00 user nova-compute[74882]: INFO nova.compute.manager [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Terminating instance
Nov 21 14:50:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-34c592d1-e8c7-4e74-9470-65ff20514acd req-33ea5fc1-4f8b-4bae-b737-6b33b7a75caa service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-unplugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Instance destroyed successfully.
Nov 21 14:50:01 user nova-compute[74882]: DEBUG nova.objects.instance [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lazy-loading 'resources' on Instance uuid 2be9dfed-8102-4797-9d47-13041ed0a4ef {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-133109328',display_name='tempest-ServerStableDeviceRescueTest-server-133109328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-133109328',id=42,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHNmtipo1wU5OMs2w2xiTJOR6qMSY/j0Cp9ebE0YDGN2Tt3kxaT2nhewhyeEiRj0ugTAPd8QBkOGXJIMLvcE7YmsWU9Xk4fM78Vj52XJL9sQFqG1gb6MIB0acIEKHcZg==',key_name='tempest-keypair-1394726022',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35cfaa913094e829acc68857bba4d55',ramdisk_id='',reservation_id='r-rm0rskwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-218360850',owner_user_name='tempest-ServerStableDeviceRescueTest-218360850-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6dc4469b07049be829644dfecf5745e',uuid=2be9dfed-8102-4797-9d47-13041ed0a4ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converting VIF {"id": "9c201a78-a3ad-4da1-9620-26544a9493b9", "address": "fa:16:3e:46:36:47", "network": {"id": "e69e1d79-189d-4a6c-8f13-8ae9ca73e20d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1004185479-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35cfaa913094e829acc68857bba4d55", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c201a78-a3", "ovs_interfaceid": "9c201a78-a3ad-4da1-9620-26544a9493b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG os_vif [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c201a78-a3, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ab23c34-6783-4907-b80a-c844d9b0bba6) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:01 user nova-compute[74882]: INFO os_vif [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:36:47,bridge_name='br-int',has_traffic_filtering=True,id=9c201a78-a3ad-4da1-9620-26544a9493b9,network=Network(e69e1d79-189d-4a6c-8f13-8ae9ca73e20d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c201a78-a3')
Nov 21 14:50:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Deleting instance files /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef_del
Nov 21 14:50:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Deletion of /opt/stack/data/nova/instances/2be9dfed-8102-4797-9d47-13041ed0a4ef_del complete
Nov 21 14:50:01 user nova-compute[74882]: INFO nova.compute.manager [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 21 14:50:01 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:50:01 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:50:02 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Took 1.03 seconds to deallocate network for instance.
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:02 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Deleted allocations for instance 2be9dfed-8102-4797-9d47-13041ed0a4ef
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-808d01d3-1f04-4ab4-8296-62bd3f85d17e tempest-ServerStableDeviceRescueTest-218360850 tempest-ServerStableDeviceRescueTest-218360850-project-member] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Acquiring lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] Lock "2be9dfed-8102-4797-9d47-13041ed0a4ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] No waiting events found dispatching network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:02 user nova-compute[74882]: WARNING nova.compute.manager [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received unexpected event network-vif-plugged-9c201a78-a3ad-4da1-9620-26544a9493b9 for instance with vm_state deleted and task_state None.
Nov 21 14:50:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-7814286a-4a85-427a-8469-a65e948327b3 req-3774b66c-9e3e-48c4-94e7-d56da3b317b5 service nova] [instance: 2be9dfed-8102-4797-9d47-13041ed0a4ef] Received event network-vif-deleted-9c201a78-a3ad-4da1-9620-26544a9493b9 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:50:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:50:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:50:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:46 user nova-compute[74882]: INFO nova.compute.manager [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Terminating instance
Nov 21 14:50:46 user nova-compute[74882]: DEBUG nova.compute.manager [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.compute.manager [req-f8a94a70-cd06-4bc1-aeab-ee18938bf415 req-3ddd9917-0e29-4400-b7ce-d94746c796a6 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Instance destroyed successfully.
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lazy-loading 'resources' on Instance uuid 3cf2345b-bb3d-4bab-a89a-ca50af5fd539 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T14:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-744304248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-744304248',id=43,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWSWM7hKRLSDhHNLt8+WbBMqDCHWTKHdi/qT5EvjhUmMORwEUFq8yP0AXHv5t4D2CKrfo4oSwn7TwNq1eJ0+LVIeelZCR9xZsBuHTuZi19lUSNdrfgNSdbgCudlVnYvrw==',key_name='tempest-keypair-1578555145',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:49:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47eba7494a3b42929f2007ff8162d9bb',ramdisk_id='',reservation_id='r-8ibbq2j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1109379350',owner_user_name='tempest-AttachVolumeShelveTestJSON-1109379350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0bd7642251d4e968bb108362dee3a3b',uuid=3cf2345b-bb3d-4bab-a89a-ca50af5fd539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converting VIF {"id": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "address": "fa:16:3e:f3:39:0f", "network": {"id": "1981ff0c-e14d-4f27-8ea1-facd0d2dd886", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-435340893-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47eba7494a3b42929f2007ff8162d9bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9aeb9b-ae", "ovs_interfaceid": "bc9aeb9b-ae63-4f22-89d4-25c6644afee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG os_vif [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc9aeb9b-ae, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d64904c-af42-4bdc-9bf3-f9e26099e1f9) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:50:47 user nova-compute[74882]: INFO os_vif [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:39:0f,bridge_name='br-int',has_traffic_filtering=True,id=bc9aeb9b-ae63-4f22-89d4-25c6644afee8,network=Network(1981ff0c-e14d-4f27-8ea1-facd0d2dd886),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9aeb9b-ae')
Nov 21 14:50:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Deleting instance files /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539_del
Nov 21 14:50:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Deletion of /opt/stack/data/nova/instances/3cf2345b-bb3d-4bab-a89a-ca50af5fd539_del complete
Nov 21 14:50:47 user nova-compute[74882]: INFO nova.compute.manager [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 21 14:50:47 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:50:47 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:50:48 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Took 0.80 seconds to deallocate network for instance.
Nov 21 14:50:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-885f4f8a-b3c2-4ddc-831c-7e88ef11adc5 req-0beb3629-7189-4cb5-bcbf-b63ab6f73ba0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-deleted-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:50:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:48 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Deleted allocations for instance 3cf2345b-bb3d-4bab-a89a-ca50af5fd539
Nov 21 14:50:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c177b55-b058-4dc6-9065-454cb69d9b7f tempest-AttachVolumeShelveTestJSON-1109379350 tempest-AttachVolumeShelveTestJSON-1109379350-project-member] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.990s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:49 user nova-compute[74882]: WARNING nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state deleted and task_state None.
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:49 user nova-compute[74882]: WARNING nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state deleted and task_state None.
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:49 user nova-compute[74882]: WARNING nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state deleted and task_state None.
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:49 user nova-compute[74882]: WARNING nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-unplugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state deleted and task_state None.
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Acquiring lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] Lock "3cf2345b-bb3d-4bab-a89a-ca50af5fd539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] No waiting events found dispatching network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:50:49 user nova-compute[74882]: WARNING nova.compute.manager [req-ca0709f6-3453-470e-85a7-7650d05ae9d1 req-8484286d-0044-4a0c-9533-1491f84bdac0 service nova] [instance: 3cf2345b-bb3d-4bab-a89a-ca50af5fd539] Received unexpected event network-vif-plugged-bc9aeb9b-ae63-4f22-89d4-25c6644afee8 for instance with vm_state deleted and task_state None.
Nov 21 14:50:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:50:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:50:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:50:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:50:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:50:55 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9070MB free_disk=25.161636352539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:50:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:50:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:50:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:50:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:50:56 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:50:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:50:56 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:50:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:50:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:50:57 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:50:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:50:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:50:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:51:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:51:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:51:02 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:51:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:51:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:51:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:51:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:51:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:51:21 user nova-compute[74882]: INFO nova.compute.claims [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Claim successful on node user
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:51:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.policy [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:51:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Creating image(s)
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "/opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "/opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "/opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "de38d66220f6318c8404d57d23e77da464850527" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "de38d66220f6318c8404d57d23e77da464850527" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG nova.virt.images [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 51f4fba5-d6ff-4868-8646-c13206d23e0f was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.part /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Successfully created port: c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.part /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.converted" returned: 0 in 0.287s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "de38d66220f6318c8404d57d23e77da464850527" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.186s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json" returned: 0 in 0.166s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "de38d66220f6318c8404d57d23e77da464850527" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "de38d66220f6318c8404d57d23e77da464850527" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json" returned: 0 in 0.171s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527,backing_fmt=raw /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527,backing_fmt=raw /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk 1073741824" returned: 0 in 0.067s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "de38d66220f6318c8404d57d23e77da464850527" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Successfully updated port: c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-changed-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing instance network info cache due to event network-changed-c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Cannot resize image /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Ensure instance console log exists: /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance network_info: |[{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.neutron [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing network info cache for port c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Start _get_guest_xml network_info=[{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:51:19Z,direct_url=<?>,disk_format='qcow2',id=51f4fba5-d6ff-4868-8646-c13206d23e0f,min_disk=0,min_ram=0,name='tempest-scenario-img--1245224520',owner='ddd03d02c8844c0fa58fa10c7c1dcbbc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:51:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '51f4fba5-d6ff-4868-8646-c13206d23e0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:51:24 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:51:24 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:51:19Z,direct_url=<?>,disk_format='qcow2',id=51f4fba5-d6ff-4868-8646-c13206d23e0f,min_disk=0,min_ram=0,name='tempest-scenario-img--1245224520',owner='ddd03d02c8844c0fa58fa10c7c1dcbbc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:51:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1374358955',display_name='tempest-TestMinimumBasicScenario-server-1374358955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1374358955',id=44,image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHcsgbkBGqI6XykfhmhkotuUIK1eXjpSMuQ0FvQm/vD/QlNX32DwqsfHXFcsbbmdlmCAk/g2V8A6RhXQkH1dyau2OyQw94DjkOSDNjkVgWvHJK/FlPvp8/mo+KzuYkTwQ==',key_name='tempest-TestMinimumBasicScenario-1354020085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-on80p6od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:51:22Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=203f1ad6-0f2b-4b04-a94f-a1f690a901c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'pci_devices' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:51:24 user nova-compute[74882]:   <uuid>203f1ad6-0f2b-4b04-a94f-a1f690a901c8</uuid>
Nov 21 14:51:24 user nova-compute[74882]:   <name>instance-0000002c</name>
Nov 21 14:51:24 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:51:24 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:51:24 user nova-compute[74882]:   <metadata>
Nov 21 14:51:24 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:51:24 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:51:24 user nova-compute[74882]:       <nova:name>tempest-TestMinimumBasicScenario-server-1374358955</nova:name>
Nov 21 14:51:24 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:51:24</nova:creationTime>
Nov 21 14:51:24 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:51:24 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:51:24 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:51:24 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:51:24 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:51:24 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:51:24 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:51:24 user nova-compute[74882]:       <nova:owner>
Nov 21 14:51:24 user nova-compute[74882]:         <nova:user uuid="e89a65d91d2f4dd9b1b143107b84d2b2">tempest-TestMinimumBasicScenario-895289717-project-member</nova:user>
Nov 21 14:51:24 user nova-compute[74882]:         <nova:project uuid="ddd03d02c8844c0fa58fa10c7c1dcbbc">tempest-TestMinimumBasicScenario-895289717</nova:project>
Nov 21 14:51:24 user nova-compute[74882]:       </nova:owner>
Nov 21 14:51:24 user nova-compute[74882]:       <nova:root type="image" uuid="51f4fba5-d6ff-4868-8646-c13206d23e0f"/>
Nov 21 14:51:24 user nova-compute[74882]:       <nova:ports>
Nov 21 14:51:24 user nova-compute[74882]:         <nova:port uuid="c66b624c-4a21-42f8-99af-379770f4f587">
Nov 21 14:51:24 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:51:24 user nova-compute[74882]:         </nova:port>
Nov 21 14:51:24 user nova-compute[74882]:       </nova:ports>
Nov 21 14:51:24 user nova-compute[74882]:     </nova:instance>
Nov 21 14:51:24 user nova-compute[74882]:   </metadata>
Nov 21 14:51:24 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:51:24 user nova-compute[74882]:     <system>
Nov 21 14:51:24 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:51:24 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:51:24 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:51:24 user nova-compute[74882]:       <entry name="serial">203f1ad6-0f2b-4b04-a94f-a1f690a901c8</entry>
Nov 21 14:51:24 user nova-compute[74882]:       <entry name="uuid">203f1ad6-0f2b-4b04-a94f-a1f690a901c8</entry>
Nov 21 14:51:24 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:51:24 user nova-compute[74882]:     </system>
Nov 21 14:51:24 user nova-compute[74882]:   </sysinfo>
Nov 21 14:51:24 user nova-compute[74882]:   <os>
Nov 21 14:51:24 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:51:24 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:51:24 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:51:24 user nova-compute[74882]:   </os>
Nov 21 14:51:24 user nova-compute[74882]:   <features>
Nov 21 14:51:24 user nova-compute[74882]:     <acpi/>
Nov 21 14:51:24 user nova-compute[74882]:     <apic/>
Nov 21 14:51:24 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:51:24 user nova-compute[74882]:   </features>
Nov 21 14:51:24 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:51:24 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:51:24 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:51:24 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:51:24 user nova-compute[74882]:   </clock>
Nov 21 14:51:24 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:51:24 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:51:24 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:51:24 user nova-compute[74882]:   </cpu>
Nov 21 14:51:24 user nova-compute[74882]:   <devices>
Nov 21 14:51:24 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:51:24 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:51:24 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk"/>
Nov 21 14:51:24 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:51:24 user nova-compute[74882]:     </disk>
Nov 21 14:51:24 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:51:24 user nova-compute[74882]:       <mac address="fa:16:3e:8e:bd:58"/>
Nov 21 14:51:24 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:51:24 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:51:24 user nova-compute[74882]:       <target dev="tapc66b624c-4a"/>
Nov 21 14:51:24 user nova-compute[74882]:     </interface>
Nov 21 14:51:24 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:51:24 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/console.log" append="off"/>
Nov 21 14:51:24 user nova-compute[74882]:     </serial>
Nov 21 14:51:24 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:51:24 user nova-compute[74882]:     <video>
Nov 21 14:51:24 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:51:24 user nova-compute[74882]:     </video>
Nov 21 14:51:24 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:51:24 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:51:24 user nova-compute[74882]:     </rng>
Nov 21 14:51:24 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:51:24 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:51:24 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:51:24 user nova-compute[74882]:     </memballoon>
Nov 21 14:51:24 user nova-compute[74882]:   </devices>
Nov 21 14:51:24 user nova-compute[74882]: </domain>
Nov 21 14:51:24 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1374358955',display_name='tempest-TestMinimumBasicScenario-server-1374358955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1374358955',id=44,image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHcsgbkBGqI6XykfhmhkotuUIK1eXjpSMuQ0FvQm/vD/QlNX32DwqsfHXFcsbbmdlmCAk/g2V8A6RhXQkH1dyau2OyQw94DjkOSDNjkVgWvHJK/FlPvp8/mo+KzuYkTwQ==',key_name='tempest-TestMinimumBasicScenario-1354020085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-on80p6od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:51:22Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=203f1ad6-0f2b-4b04-a94f-a1f690a901c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG os_vif [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58692f1a-cb8d-5320-b06c-60e32e8c3eb9', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66b624c-4a, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66b624c-4a, col_values=(('qos', UUID('96c2b774-eaf1-460c-abac-540eaa1b6b13')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66b624c-4a, col_values=(('external_ids', {'iface-id': 'c66b624c-4a21-42f8-99af-379770f4f587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:bd:58', 'vm-uuid': '203f1ad6-0f2b-4b04-a94f-a1f690a901c8'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:24 user nova-compute[74882]: INFO os_vif [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a')
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No VIF found with MAC fa:16:3e:8e:bd:58, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.neutron [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated VIF entry in instance network info cache for port c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG nova.network.neutron [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:51:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-8717aaaa-0b28-4d92-8f9c-197179283c0b req-2712e5b0-6753-4874-a716-79a587220983 service nova] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG nova.compute.manager [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:25 user nova-compute[74882]: DEBUG nova.compute.manager [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:51:25 user nova-compute[74882]: WARNING nova.compute.manager [req-32b67494-b211-40fc-97c2-0f6b6ca155a9 req-68c1b528-457c-4c8c-8a84-8f8a955c17f5 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received unexpected event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with vm_state building and task_state spawning.
Nov 21 14:51:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:51:27 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance spawned successfully.
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:51:27 user nova-compute[74882]: INFO nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:51:27 user nova-compute[74882]: WARNING nova.compute.manager [req-982bf5a7-2df5-412c-9e20-2e69577fa825 req-4e76c13a-6efe-427d-801c-3bf4dbabfc7e service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received unexpected event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with vm_state building and task_state spawning.
Nov 21 14:51:27 user nova-compute[74882]: INFO nova.compute.manager [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Took 6.43 seconds to build instance.
Nov 21 14:51:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6e290f0-910a-419c-8d33-14ae72af3672 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.525s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:51:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:51:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:51:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:51:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:58 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:51:58 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:51:58 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=25.06158447265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:51:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:51:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:51:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:51:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:52:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:52:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:52:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:52:00 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:52:00 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:52:01 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:52:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:52:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:52:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:02 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:52:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:52:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:52:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:52:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:52:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:52:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:52:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:52:59 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:00 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:53:00 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:53:00 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.058937072753906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:53:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:53:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:53:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:53:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:53:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:53:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'flavor' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:15 user nova-compute[74882]: INFO nova.compute.manager [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Attaching volume 4724c4e0-75c0-489b-b122-5af4eb077ba8 to /dev/vdb
Nov 21 14:53:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9703fe-b0d6-4071-be3c-258a218a8e1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d196a-630b-4098-be26-caec5efa3ca9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ea8c1-9bef-4f33-b561-31356217a097]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc0aaff-e172-4b09-9e32-c23343798895]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:53:15 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:53:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[08351e73-9f06-455c-99c6-1a8577f5ec7b]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:53:15 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating existing volume attachment record: fc7de8b2-2086-42e2-bb6a-911e0c905ccf {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:53:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verify base images {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Image id 51f4fba5-d6ff-4868-8646-c13206d23e0f yields fingerprint de38d66220f6318c8404d57d23e77da464850527 {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] image 51f4fba5-d6ff-4868-8646-c13206d23e0f at (/opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527): checking
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] image 51f4fba5-d6ff-4868-8646-c13206d23e0f at (/opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527): image is in use {{(pid=74882) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 is a valid instance name {{(pid=74882) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 has a disk file {{(pid=74882) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 is backed by de38d66220f6318c8404d57d23e77da464850527 {{(pid=74882) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9
Nov 21 14:53:20 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Active base files: /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Removable base files: /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876 /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9 /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9
Nov 21 14:53:20 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verification complete {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verify swap images {{(pid=74882) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 21 14:53:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verify ephemeral images {{(pid=74882) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'reJwcNmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:53:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:53:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:53:21 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e947288e-ef93-4302-98af-1d6dd9b1d153]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:53:21 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b0d6a7-4506-4777-88e5-d2ea79a9871d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8] added
Nov 21 14:53:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26aacf7-1c54-4b3d-af74-6e71913cfe7e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af4cf8-f045-49f4-a125-be37102bc7a4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v reJwcNmg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v reJwcNmg" returned: 0 in 0.028s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[75844594-18b3-40d9-a6fe-b3c87d15f878]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'reJwcNmg'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e01244-125d-4771-9be5-52fd529c4307]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8068a3fc-f2e3-406f-ad04-086a2a32c66e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:53:21 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:53:21 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:53:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 14:53:21 user nova-compute[74882]: 
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c638a3c-3588-4cef-99f9-a94628ac8f44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]
Nov 21 14:53:21 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.
Nov 21 14:53:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f8aa5b-9a9b-44bd-916c-32832e2684ea]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3793f9-9f53-4837-849d-179c7e722ef1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:53:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:53:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a34a866-bbe2-4a56-bb07-28a1fbe1fff1]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:53:22 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:53:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'reJwcNmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:53:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:53:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23235616436643631', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:53:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235616436643631', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:53:22 user nova-compute[74882]: DEBUG nova.objects.instance [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'flavor' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:53:22 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:53:22 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:53:22 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:53:22 user nova-compute[74882]:   <serial>4724c4e0-75c0-489b-b122-5af4eb077ba8</serial>
Nov 21 14:53:22 user nova-compute[74882]: </disk>
Nov 21 14:53:22 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:53:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:53:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:53:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No VIF found with MAC fa:16:3e:8e:bd:58, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:53:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-a01d0f69-05c4-49e6-9764-9417768c72e0 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.007s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-changed-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing instance network info cache due to event network-changed-c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG nova.network.neutron [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing network info cache for port c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG nova.network.neutron [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated VIF entry in instance network info cache for port c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG nova.network.neutron [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:53:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f4cdc571-205c-413f-9ba4-96c4a1eef3c1 req-77dc60cb-0e6d-4104-810e-87c10ae573d4 service nova] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-changed-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing instance network info cache due to event network-changed-c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing network info cache for port c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated VIF entry in instance network info cache for port c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:53:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-47a8725c-780c-4965-a330-052bc38925de req-1975a2d3-70c2-42f3-89b3-68691a4e6599 service nova] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:53:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:35 user nova-compute[74882]: INFO nova.compute.manager [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Rebooting instance
Nov 21 14:53:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:53:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:53:35 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-unplugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:36 user nova-compute[74882]: DEBUG nova.compute.manager [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-unplugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:53:36 user nova-compute[74882]: WARNING nova.compute.manager [req-89cd9234-2255-41e5-af38-b10137fe31d7 req-0cec9e03-b2f8-4bbf-893c-f5188152cabe service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received unexpected event network-vif-unplugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with vm_state active and task_state reboot_started_hard.
Nov 21 14:53:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance destroyed successfully.
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'resources' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1374358955',display_name='tempest-TestMinimumBasicScenario-server-1374358955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1374358955',id=44,image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHcsgbkBGqI6XykfhmhkotuUIK1eXjpSMuQ0FvQm/vD/QlNX32DwqsfHXFcsbbmdlmCAk/g2V8A6RhXQkH1dyau2OyQw94DjkOSDNjkVgWvHJK/FlPvp8/mo+KzuYkTwQ==',key_name='tempest-TestMinimumBasicScenario-1354020085',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-on80p6od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:53:36Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=203f1ad6-0f2b-4b04-a94f-a1f690a901c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_vif [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66b624c-4a, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96c2b774-eaf1-460c-abac-540eaa1b6b13) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:53:37 user nova-compute[74882]: INFO os_vif [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a')
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'reJwcNmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:53:37 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[965412d5-083d-44df-bad1-3dae349e6708]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:53:37 user nova-compute[74882]: No targets found.
Nov 21 14:53:37 user nova-compute[74882]: iSNS:
Nov 21 14:53:37 user nova-compute[74882]: No targets found.
Nov 21 14:53:37 user nova-compute[74882]: STATIC:
Nov 21 14:53:37 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8
Nov 21 14:53:37 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:53:37 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:53:37 user nova-compute[74882]: FIRMWARE:
Nov 21 14:53:37 user nova-compute[74882]: No targets found.
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:53:37 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:53:37 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[139bc609-5d56-4a31-a6cd-fc17418eba8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c62ea1-96a1-44ea-b06a-6200d5ea03c1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c6235b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b2488e-fc86-44a4-a466-619306ef52c0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ea74d-63f3-41d0-b680-a09c9b2c4d40]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd57b13-a45b-424b-8d5c-2e15fd317e72]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[da388735-773c-450b-bc8a-915bd256b676]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9512e4c3-3877-4343-b59e-ce028a05c02b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0b1ed3-3f33-421f-ae04-0a9366016e02]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]
Nov 21 14:53:37 user nova-compute[74882]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d4cdd-0d5a-4772-892f-d2237846bd1e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== disconnect_volume: return (345ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Start _get_guest_xml network_info=[{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51f4fba5-d6ff-4868-8646-c13206d23e0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '51f4fba5-d6ff-4868-8646-c13206d23e0f'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'reJwcNmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '203f1ad6-0f2b-4b04-a94f-a1f690a901c8', 'attached_at': '', 'detached_at': '', 'volume_id': '4724c4e0-75c0-489b-b122-5af4eb077ba8', 'serial': '4724c4e0-75c0-489b-b122-5af4eb077ba8'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'fc7de8b2-2086-42e2-bb6a-911e0c905ccf', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:53:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:53:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51f4fba5-d6ff-4868-8646-c13206d23e0f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'vcpu_model' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.objects.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Object Instance<203f1ad6-0f2b-4b04-a94f-a1f690a901c8> lazy-loaded attributes: resources,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'reJwcNmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:53:37 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:53:37 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:53:37 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da12469-4119-4f02-b53f-1eb0ac706971]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:53:37 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[71699a31-c4c0-4ece-94ba-cad54d692166]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8] added
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[62614d3f-d227-4559-8d2c-a487579f2a33]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8784bc1e-28ce-4140-adff-77b6344ecf9e]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v reJwcNmg {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v reJwcNmg" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[634aa859-7f5a-4327-a126-e2e526337af8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'reJwcNmg'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219131e-952d-4eb6-acf9-38a394adae82]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7740a51e-4f59-49ed-8930-a69922fe6211]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:53:37 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:53:37 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:53:37 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 14:53:37 user nova-compute[74882]: 
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[59586186-6136-4ba4-9013-08a89f449c4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]
Nov 21 14:53:37 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f9dd0-9e99-4401-a571-6b091d5b80f7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3cd101-de1f-4c89-afa8-8f3cc6ef51c0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:53:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf40e2f-d12c-48a6-adc7-c0338d2da94a]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:53:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.compute.manager [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:53:38 user nova-compute[74882]: WARNING nova.compute.manager [req-b84277fe-c18a-4938-9f45-955fef676ee5 req-1767ac5a-ac5a-4a23-a9dc-daba499b6252 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received unexpected event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with vm_state active and task_state reboot_started_hard.
Nov 21 14:53:38 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'reJwcNmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23235616436643631', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235616436643631', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1374358955',display_name='tempest-TestMinimumBasicScenario-server-1374358955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1374358955',id=44,image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHcsgbkBGqI6XykfhmhkotuUIK1eXjpSMuQ0FvQm/vD/QlNX32DwqsfHXFcsbbmdlmCAk/g2V8A6RhXQkH1dyau2OyQw94DjkOSDNjkVgWvHJK/FlPvp8/mo+KzuYkTwQ==',key_name='tempest-TestMinimumBasicScenario-1354020085',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-on80p6od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:53:36Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=203f1ad6-0f2b-4b04-a94f-a1f690a901c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'pci_devices' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.objects.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Object Instance<203f1ad6-0f2b-4b04-a94f-a1f690a901c8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:53:38 user nova-compute[74882]:   <uuid>203f1ad6-0f2b-4b04-a94f-a1f690a901c8</uuid>
Nov 21 14:53:38 user nova-compute[74882]:   <name>instance-0000002c</name>
Nov 21 14:53:38 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:53:38 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:53:38 user nova-compute[74882]:   <metadata>
Nov 21 14:53:38 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:53:38 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:53:38 user nova-compute[74882]:       <nova:name>tempest-TestMinimumBasicScenario-server-1374358955</nova:name>
Nov 21 14:53:38 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:53:37</nova:creationTime>
Nov 21 14:53:38 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:53:38 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:53:38 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:53:38 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:53:38 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:53:38 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:53:38 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:53:38 user nova-compute[74882]:       <nova:owner>
Nov 21 14:53:38 user nova-compute[74882]:         <nova:user uuid="e89a65d91d2f4dd9b1b143107b84d2b2">tempest-TestMinimumBasicScenario-895289717-project-member</nova:user>
Nov 21 14:53:38 user nova-compute[74882]:         <nova:project uuid="ddd03d02c8844c0fa58fa10c7c1dcbbc">tempest-TestMinimumBasicScenario-895289717</nova:project>
Nov 21 14:53:38 user nova-compute[74882]:       </nova:owner>
Nov 21 14:53:38 user nova-compute[74882]:       <nova:root type="image" uuid="51f4fba5-d6ff-4868-8646-c13206d23e0f"/>
Nov 21 14:53:38 user nova-compute[74882]:       <nova:ports>
Nov 21 14:53:38 user nova-compute[74882]:         <nova:port uuid="c66b624c-4a21-42f8-99af-379770f4f587">
Nov 21 14:53:38 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 21 14:53:38 user nova-compute[74882]:         </nova:port>
Nov 21 14:53:38 user nova-compute[74882]:       </nova:ports>
Nov 21 14:53:38 user nova-compute[74882]:     </nova:instance>
Nov 21 14:53:38 user nova-compute[74882]:   </metadata>
Nov 21 14:53:38 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:53:38 user nova-compute[74882]:     <system>
Nov 21 14:53:38 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:53:38 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:53:38 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:53:38 user nova-compute[74882]:       <entry name="serial">203f1ad6-0f2b-4b04-a94f-a1f690a901c8</entry>
Nov 21 14:53:38 user nova-compute[74882]:       <entry name="uuid">203f1ad6-0f2b-4b04-a94f-a1f690a901c8</entry>
Nov 21 14:53:38 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:53:38 user nova-compute[74882]:     </system>
Nov 21 14:53:38 user nova-compute[74882]:   </sysinfo>
Nov 21 14:53:38 user nova-compute[74882]:   <os>
Nov 21 14:53:38 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:53:38 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:53:38 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:53:38 user nova-compute[74882]:   </os>
Nov 21 14:53:38 user nova-compute[74882]:   <features>
Nov 21 14:53:38 user nova-compute[74882]:     <acpi/>
Nov 21 14:53:38 user nova-compute[74882]:     <apic/>
Nov 21 14:53:38 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:53:38 user nova-compute[74882]:   </features>
Nov 21 14:53:38 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:53:38 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:53:38 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:53:38 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:53:38 user nova-compute[74882]:   </clock>
Nov 21 14:53:38 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:53:38 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:53:38 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:53:38 user nova-compute[74882]:   </cpu>
Nov 21 14:53:38 user nova-compute[74882]:   <devices>
Nov 21 14:53:38 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:53:38 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:53:38 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk"/>
Nov 21 14:53:38 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:53:38 user nova-compute[74882]:     </disk>
Nov 21 14:53:38 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 14:53:38 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:53:38 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 14:53:38 user nova-compute[74882]:       <target dev="vdb" bus="virtio"/>
Nov 21 14:53:38 user nova-compute[74882]:       <serial>4724c4e0-75c0-489b-b122-5af4eb077ba8</serial>
Nov 21 14:53:38 user nova-compute[74882]:     </disk>
Nov 21 14:53:38 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:53:38 user nova-compute[74882]:       <mac address="fa:16:3e:8e:bd:58"/>
Nov 21 14:53:38 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:53:38 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:53:38 user nova-compute[74882]:       <target dev="tapc66b624c-4a"/>
Nov 21 14:53:38 user nova-compute[74882]:     </interface>
Nov 21 14:53:38 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:53:38 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/console.log" append="off"/>
Nov 21 14:53:38 user nova-compute[74882]:     </serial>
Nov 21 14:53:38 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:53:38 user nova-compute[74882]:     <video>
Nov 21 14:53:38 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:53:38 user nova-compute[74882]:     </video>
Nov 21 14:53:38 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:53:38 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:53:38 user nova-compute[74882]:     </rng>
Nov 21 14:53:38 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:53:38 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:53:38 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:53:38 user nova-compute[74882]:     </memballoon>
Nov 21 14:53:38 user nova-compute[74882]:   </devices>
Nov 21 14:53:38 user nova-compute[74882]: </domain>
Nov 21 14:53:38 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:53:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'trusted_certs' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Object Instance<203f1ad6-0f2b-4b04-a94f-a1f690a901c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Cannot resize image /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'migration_context' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.objects.base [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Object Instance<203f1ad6-0f2b-4b04-a94f-a1f690a901c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1374358955',display_name='tempest-TestMinimumBasicScenario-server-1374358955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1374358955',id=44,image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHcsgbkBGqI6XykfhmhkotuUIK1eXjpSMuQ0FvQm/vD/QlNX32DwqsfHXFcsbbmdlmCAk/g2V8A6RhXQkH1dyau2OyQw94DjkOSDNjkVgWvHJK/FlPvp8/mo+KzuYkTwQ==',key_name='tempest-TestMinimumBasicScenario-1354020085',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-on80p6od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:53:36Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=203f1ad6-0f2b-4b04-a94f-a1f690a901c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG os_vif [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58692f1a-cb8d-5320-b06c-60e32e8c3eb9', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc66b624c-4a, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc66b624c-4a, col_values=(('qos', UUID('75fc8476-d7c4-47cf-901f-2500489be109')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc66b624c-4a, col_values=(('external_ids', {'iface-id': 'c66b624c-4a21-42f8-99af-379770f4f587', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:bd:58', 'vm-uuid': '203f1ad6-0f2b-4b04-a94f-a1f690a901c8'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:53:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:39 user nova-compute[74882]: INFO os_vif [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a')
Nov 21 14:53:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:53:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:53:41 user nova-compute[74882]: WARNING nova.compute.manager [req-2a9ff3fb-b6cf-428f-8545-87439f49a607 req-a880d77b-dc11-4830-95f2-7e132999b97f service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received unexpected event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with vm_state active and task_state reboot_started_hard.
Nov 21 14:53:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:53:43 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance rebooted successfully.
Nov 21 14:53:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:53:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6416f8b3-3252-41a7-979e-72184a7e57cf tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.753s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:53:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:53:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:53:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:53:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:53:43 user nova-compute[74882]: WARNING nova.compute.manager [req-d2026681-91e1-408d-8172-ebbb00ef1d86 req-c74182fa-921e-40b5-a980-ea10e9b536c2 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received unexpected event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with vm_state active and task_state None.
Nov 21 14:53:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:53:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:53:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:53:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:54:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:54:02 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:54:02 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=25.056835174560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:54:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:54:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:54:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:05 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:54:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:54:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:54:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:54:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:54:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:54:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:54:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 14:54:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:54:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:54:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:54:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:54:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:54 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:54:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:54:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:55:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:55:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:55:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:55:03 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:55:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:04 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:55:04 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:55:04 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.05609130859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:55:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:55:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:55:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:08 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:55:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:55:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:55:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-changed-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing instance network info cache due to event network-changed-c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG nova.network.neutron [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing network info cache for port c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG nova.network.neutron [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated VIF entry in instance network info cache for port c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG nova.network.neutron [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:55:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-966dcb72-0f9c-4329-a6c1-bc8c9a92cc01 req-b0e9e018-a9bc-44f5-875c-dadfd7861426 service nova] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-changed-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing instance network info cache due to event network-changed-c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.network.neutron [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Refreshing network info cache for port c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:55:28 user nova-compute[74882]: INFO nova.compute.manager [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Detaching volume 4724c4e0-75c0-489b-b122-5af4eb077ba8
Nov 21 14:55:28 user nova-compute[74882]: INFO nova.virt.block_device [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Attempting to driver detach volume 4724c4e0-75c0-489b-b122-5af4eb077ba8 from mountpoint /dev/vdb
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Attempting to detach device vdb from instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:55:28 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:55:28 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:55:28 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:55:28 user nova-compute[74882]:   <serial>4724c4e0-75c0-489b-b122-5af4eb077ba8</serial>
Nov 21 14:55:28 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:55:28 user nova-compute[74882]: </disk>
Nov 21 14:55:28 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:55:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully detached device vdb from instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 from the persistent domain config.
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 14:55:28 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:55:28 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:55:28 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:55:28 user nova-compute[74882]:   <serial>4724c4e0-75c0-489b-b122-5af4eb077ba8</serial>
Nov 21 14:55:28 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 21 14:55:28 user nova-compute[74882]: </disk>
Nov 21 14:55:28 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.network.neutron [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated VIF entry in instance network info cache for port c66b624c-4a21-42f8-99af-379770f4f587. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.network.neutron [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-19cb8740-186b-4523-883e-1bd697c65031 req-349ee4d1-5c55-4030-9777-3b41e8e08d02 service nova] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:55:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 14:55:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 is timed out.
Nov 21 14:55:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully detached device vdb from instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 from the live domain config.
Nov 21 14:55:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'reJwcNmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:55:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea3508-56c4-419b-b28e-8de8b83ffb2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 14:55:49 user nova-compute[74882]: No targets found.
Nov 21 14:55:49 user nova-compute[74882]: iSNS:
Nov 21 14:55:49 user nova-compute[74882]: No targets found.
Nov 21 14:55:49 user nova-compute[74882]: STATIC:
Nov 21 14:55:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8
Nov 21 14:55:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 14:55:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 14:55:49 user nova-compute[74882]: FIRMWARE:
Nov 21 14:55:49 user nova-compute[74882]: No targets found.
Nov 21 14:55:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 14:55:49 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 14:55:49 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89667e5-bbb2-4ef9-938d-6eb71b87049e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86d7cd1-59ef-4241-98e5-c76de4e9e096]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:55:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 (non-flash)
Nov 21 14:55:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c424d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e9da1-b216-49ac-91d3-3efce7bbfe91]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6587b36b-ea68-4979-aa94-f2fb7c228ccf]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb626bc-c315-45e6-831c-3aba36fa7111]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f59a6-6c3a-4349-bc7b-7fe07bf9084c]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e91b50-8632-4971-a7ee-21d0854286b7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc68bfa1-1f41-482b-a4ad-1844b3c2fb22]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260]
Nov 21 14:55:49 user nova-compute[74882]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8, portal: 172.16.0.220,3260] successful.
Nov 21 14:55:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4724c4e0-75c0-489b-b122-5af4eb077ba8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb07816-2442-4f71-a8a7-2fd2d9edb644]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== disconnect_volume: return (276ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:55:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:55:50 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'flavor' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:55:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c0b166dc-75e5-4332-abec-50dab64bc364 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.616s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:55:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:55:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:55:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:56:02 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:56:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:56:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:56:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:56:03 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:56:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [{"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-203f1ad6-0f2b-4b04-a94f-a1f690a901c8" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:04 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:56:04 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:56:04 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=25.055309295654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:56:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:56:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:56:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:56:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:56:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:56:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:56:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:56:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:56:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:56:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:56:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:56:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:56:22 user nova-compute[74882]: INFO nova.compute.manager [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Terminating instance
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-unplugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-unplugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-d729f446-943b-4ef7-9c96-16c7ecc9248f req-f8ae7050-1c1c-4dcb-a4d0-9abb9e6e6e7c service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-unplugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 14:56:22 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Instance destroyed successfully.
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'resources' on Instance uuid 203f1ad6-0f2b-4b04-a94f-a1f690a901c8 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:51:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1374358955',display_name='tempest-TestMinimumBasicScenario-server-1374358955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1374358955',id=44,image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHcsgbkBGqI6XykfhmhkotuUIK1eXjpSMuQ0FvQm/vD/QlNX32DwqsfHXFcsbbmdlmCAk/g2V8A6RhXQkH1dyau2OyQw94DjkOSDNjkVgWvHJK/FlPvp8/mo+KzuYkTwQ==',key_name='tempest-TestMinimumBasicScenario-1354020085',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-on80p6od',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51f4fba5-d6ff-4868-8646-c13206d23e0f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:53:43Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=203f1ad6-0f2b-4b04-a94f-a1f690a901c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c66b624c-4a21-42f8-99af-379770f4f587", "address": "fa:16:3e:8e:bd:58", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc66b624c-4a", "ovs_interfaceid": "c66b624c-4a21-42f8-99af-379770f4f587", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG os_vif [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc66b624c-4a, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75fc8476-d7c4-47cf-901f-2500489be109) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:22 user nova-compute[74882]: INFO os_vif [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:bd:58,bridge_name='br-int',has_traffic_filtering=True,id=c66b624c-4a21-42f8-99af-379770f4f587,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc66b624c-4a')
Nov 21 14:56:22 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Deleting instance files /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8_del
Nov 21 14:56:22 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Deletion of /opt/stack/data/nova/instances/203f1ad6-0f2b-4b04-a94f-a1f690a901c8_del complete
Nov 21 14:56:23 user nova-compute[74882]: INFO nova.compute.manager [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 21 14:56:23 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:56:23 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Took 0.44 seconds to deallocate network for instance.
Nov 21 14:56:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-ee4553cc-1d27-4d15-a662-16cb0b43742f req-0fa07867-4d25-4391-8302-0022b3894968 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-deleted-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:56:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:56:23 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Deleted allocations for instance 203f1ad6-0f2b-4b04-a94f-a1f690a901c8
Nov 21 14:56:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b21dc904-ea55-4ead-a2f0-899cdb84eb16 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.608s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:56:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:56:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Acquiring lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:56:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:56:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] Lock "203f1ad6-0f2b-4b04-a94f-a1f690a901c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:56:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] No waiting events found dispatching network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:56:24 user nova-compute[74882]: WARNING nova.compute.manager [req-9b1e8748-419b-4064-9b8b-150889b85d34 req-dbda415b-36f5-4209-b275-c587fb6f5ed2 service nova] [instance: 203f1ad6-0f2b-4b04-a94f-a1f690a901c8] Received unexpected event network-vif-plugged-c66b624c-4a21-42f8-99af-379770f4f587 for instance with vm_state deleted and task_state None.
Nov 21 14:56:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 14:56:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:56:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 14:56:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:56:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:56:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:56:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:57:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:57:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:57:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:57:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:57:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:57:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:57:05 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9114MB free_disk=25.082656860351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:06 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:57:06 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:57:06 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:57:06 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:57:06 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:57:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:57:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 14:57:16 user nova-compute[74882]: INFO nova.compute.claims [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Claim successful on node user
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 14:57:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.policy [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e89a65d91d2f4dd9b1b143107b84d2b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddd03d02c8844c0fa58fa10c7c1dcbbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 14:57:16 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Creating image(s)
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "/opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "/opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "/opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "1b2c6686f7df8ce90b2d04338056e4f7aaa41632" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "1b2c6686f7df8ce90b2d04338056e4f7aaa41632" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.part --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG nova.network.neutron [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Successfully created port: c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.part --force-share --output=json" returned: 0 in 0.187s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG nova.virt.images [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] abe2b915-0cc6-49c0-93e0-40433a6f5990 was qcow2, converting to raw {{(pid=74882) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG nova.privsep.utils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74882) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.part /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.converted {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.part /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.converted" returned: 0 in 0.312s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.converted --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "1b2c6686f7df8ce90b2d04338056e4f7aaa41632" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.080s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.neutron [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Successfully updated port: c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.neutron [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing instance network info cache due to event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632 --force-share --output=json" returned: 0 in 0.253s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "1b2c6686f7df8ce90b2d04338056e4f7aaa41632" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "1b2c6686f7df8ce90b2d04338056e4f7aaa41632" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.neutron [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632 --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632,backing_fmt=raw /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632,backing_fmt=raw /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk 1073741824" returned: 0 in 0.047s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "1b2c6686f7df8ce90b2d04338056e4f7aaa41632" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632 --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.neutron [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance network_info: |[{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.neutron [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632 --force-share --output=json" returned: 0 in 0.165s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Cannot resize image /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Ensure instance console log exists: /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Start _get_guest_xml network_info=[{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:57:14Z,direct_url=<?>,disk_format='qcow2',id=abe2b915-0cc6-49c0-93e0-40433a6f5990,min_disk=0,min_ram=0,name='tempest-scenario-img--888996972',owner='ddd03d02c8844c0fa58fa10c7c1dcbbc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:57:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'abe2b915-0cc6-49c0-93e0-40433a6f5990'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 14:57:18 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:57:18 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:57:14Z,direct_url=<?>,disk_format='qcow2',id=abe2b915-0cc6-49c0-93e0-40433a6f5990,min_disk=0,min_ram=0,name='tempest-scenario-img--888996972',owner='ddd03d02c8844c0fa58fa10c7c1dcbbc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:57:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1743715161',display_name='tempest-TestMinimumBasicScenario-server-1743715161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1743715161',id=45,image_ref='abe2b915-0cc6-49c0-93e0-40433a6f5990',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqeu5WaR9uaggnOaimLuzirOc8k7snoiRJ9ghk2/5FdDgSPtSEGnDDDIyc+tSFx6R3L3c4lkXOjG4ppgFcJ5TJ1N9RpnsciKPe0FWmpjaWHF1Xon+kpG+TCFMHQOa5oQQ==',key_name='tempest-TestMinimumBasicScenario-970885429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-ncgcbeu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='abe2b915-0cc6-49c0-93e0-40433a6f5990',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:57:17Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=803e69ce-6100-4c41-b07d-4dbd19adc737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=c83ac310-48f6-4cf2-8a27-db58247270ba,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83ac310-48') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.objects.instance [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'pci_devices' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.neutron [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated VIF entry in instance network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.neutron [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] End _get_guest_xml xml=<domain type="kvm">
Nov 21 14:57:18 user nova-compute[74882]:   <uuid>803e69ce-6100-4c41-b07d-4dbd19adc737</uuid>
Nov 21 14:57:18 user nova-compute[74882]:   <name>instance-0000002d</name>
Nov 21 14:57:18 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 14:57:18 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 14:57:18 user nova-compute[74882]:   <metadata>
Nov 21 14:57:18 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 14:57:18 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 14:57:18 user nova-compute[74882]:       <nova:name>tempest-TestMinimumBasicScenario-server-1743715161</nova:name>
Nov 21 14:57:18 user nova-compute[74882]:       <nova:creationTime>2023-11-21 14:57:18</nova:creationTime>
Nov 21 14:57:18 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 14:57:18 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 14:57:18 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 14:57:18 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 14:57:18 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 14:57:18 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 14:57:18 user nova-compute[74882]:       </nova:flavor>
Nov 21 14:57:18 user nova-compute[74882]:       <nova:owner>
Nov 21 14:57:18 user nova-compute[74882]:         <nova:user uuid="e89a65d91d2f4dd9b1b143107b84d2b2">tempest-TestMinimumBasicScenario-895289717-project-member</nova:user>
Nov 21 14:57:18 user nova-compute[74882]:         <nova:project uuid="ddd03d02c8844c0fa58fa10c7c1dcbbc">tempest-TestMinimumBasicScenario-895289717</nova:project>
Nov 21 14:57:18 user nova-compute[74882]:       </nova:owner>
Nov 21 14:57:18 user nova-compute[74882]:       <nova:root type="image" uuid="abe2b915-0cc6-49c0-93e0-40433a6f5990"/>
Nov 21 14:57:18 user nova-compute[74882]:       <nova:ports>
Nov 21 14:57:18 user nova-compute[74882]:         <nova:port uuid="c83ac310-48f6-4cf2-8a27-db58247270ba">
Nov 21 14:57:18 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 14:57:18 user nova-compute[74882]:         </nova:port>
Nov 21 14:57:18 user nova-compute[74882]:       </nova:ports>
Nov 21 14:57:18 user nova-compute[74882]:     </nova:instance>
Nov 21 14:57:18 user nova-compute[74882]:   </metadata>
Nov 21 14:57:18 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 14:57:18 user nova-compute[74882]:     <system>
Nov 21 14:57:18 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 14:57:18 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 14:57:18 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 14:57:18 user nova-compute[74882]:       <entry name="serial">803e69ce-6100-4c41-b07d-4dbd19adc737</entry>
Nov 21 14:57:18 user nova-compute[74882]:       <entry name="uuid">803e69ce-6100-4c41-b07d-4dbd19adc737</entry>
Nov 21 14:57:18 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 14:57:18 user nova-compute[74882]:     </system>
Nov 21 14:57:18 user nova-compute[74882]:   </sysinfo>
Nov 21 14:57:18 user nova-compute[74882]:   <os>
Nov 21 14:57:18 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 14:57:18 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 14:57:18 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 14:57:18 user nova-compute[74882]:   </os>
Nov 21 14:57:18 user nova-compute[74882]:   <features>
Nov 21 14:57:18 user nova-compute[74882]:     <acpi/>
Nov 21 14:57:18 user nova-compute[74882]:     <apic/>
Nov 21 14:57:18 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 14:57:18 user nova-compute[74882]:   </features>
Nov 21 14:57:18 user nova-compute[74882]:   <clock offset="utc">
Nov 21 14:57:18 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 14:57:18 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 14:57:18 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 14:57:18 user nova-compute[74882]:   </clock>
Nov 21 14:57:18 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 14:57:18 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 14:57:18 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 14:57:18 user nova-compute[74882]:   </cpu>
Nov 21 14:57:18 user nova-compute[74882]:   <devices>
Nov 21 14:57:18 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 14:57:18 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 14:57:18 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk"/>
Nov 21 14:57:18 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 14:57:18 user nova-compute[74882]:     </disk>
Nov 21 14:57:18 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 14:57:18 user nova-compute[74882]:       <mac address="fa:16:3e:c1:48:fc"/>
Nov 21 14:57:18 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:57:18 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 14:57:18 user nova-compute[74882]:       <target dev="tapc83ac310-48"/>
Nov 21 14:57:18 user nova-compute[74882]:     </interface>
Nov 21 14:57:18 user nova-compute[74882]:     <serial type="pty">
Nov 21 14:57:18 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/console.log" append="off"/>
Nov 21 14:57:18 user nova-compute[74882]:     </serial>
Nov 21 14:57:18 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 14:57:18 user nova-compute[74882]:     <video>
Nov 21 14:57:18 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 14:57:18 user nova-compute[74882]:     </video>
Nov 21 14:57:18 user nova-compute[74882]:     <rng model="virtio">
Nov 21 14:57:18 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 14:57:18 user nova-compute[74882]:     </rng>
Nov 21 14:57:18 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 14:57:18 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 14:57:18 user nova-compute[74882]:       <stats period="10"/>
Nov 21 14:57:18 user nova-compute[74882]:     </memballoon>
Nov 21 14:57:18 user nova-compute[74882]:   </devices>
Nov 21 14:57:18 user nova-compute[74882]: </domain>
Nov 21 14:57:18 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1743715161',display_name='tempest-TestMinimumBasicScenario-server-1743715161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1743715161',id=45,image_ref='abe2b915-0cc6-49c0-93e0-40433a6f5990',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqeu5WaR9uaggnOaimLuzirOc8k7snoiRJ9ghk2/5FdDgSPtSEGnDDDIyc+tSFx6R3L3c4lkXOjG4ppgFcJ5TJ1N9RpnsciKPe0FWmpjaWHF1Xon+kpG+TCFMHQOa5oQQ==',key_name='tempest-TestMinimumBasicScenario-970885429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-ncgcbeu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='abe2b915-0cc6-49c0-93e0-40433a6f5990',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T14:57:17Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=803e69ce-6100-4c41-b07d-4dbd19adc737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=c83ac310-48f6-4cf2-8a27-db58247270ba,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83ac310-48') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG os_vif [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=c83ac310-48f6-4cf2-8a27-db58247270ba,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83ac310-48') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e53540d-a337-53d7-922a-ae566b1f68a6', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-60f20eb2-2f0d-4f83-8434-743534bd45a3 req-36504d4c-3ff6-47c3-a58b-b9bc2b7233dc service nova] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83ac310-48, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc83ac310-48, col_values=(('qos', UUID('127c2397-376a-4249-894e-160e2b86ac54')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc83ac310-48, col_values=(('external_ids', {'iface-id': 'c83ac310-48f6-4cf2-8a27-db58247270ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:48:fc', 'vm-uuid': '803e69ce-6100-4c41-b07d-4dbd19adc737'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:18 user nova-compute[74882]: INFO os_vif [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=c83ac310-48f6-4cf2-8a27-db58247270ba,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83ac310-48')
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:57:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No VIF found with MAC fa:16:3e:c1:48:fc, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:57:20 user nova-compute[74882]: WARNING nova.compute.manager [req-e0ba58b1-fce7-4a19-a1e2-ab83f3705935 req-70943431-885a-48a9-935d-4cd22c02333c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received unexpected event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with vm_state building and task_state spawning.
Nov 21 14:57:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 14:57:22 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance spawned successfully.
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 14:57:22 user nova-compute[74882]: INFO nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:57:22 user nova-compute[74882]: INFO nova.compute.manager [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Took 6.14 seconds to build instance.
Nov 21 14:57:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-05b0fce1-edbd-4cf7-9653-ae6cdc995e0d tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.238s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:57:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:57:22 user nova-compute[74882]: WARNING nova.compute.manager [req-aa4526d0-67eb-4ee5-aa78-fb8b1f6a082b req-3f3d78c1-9cdf-406b-8c9b-ae405eab6b9d service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received unexpected event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with vm_state active and task_state None.
Nov 21 14:57:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:57:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:57:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:58:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:58:04 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:58:05 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:58:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:58:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:58:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:58:08 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:58:08 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:58:08 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.032222747802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:58:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:58:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:12 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:58:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:58:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:01 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 14:59:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 14:59:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 14:59:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:59:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:59:05 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 14:59:05 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:59:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:59:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:59:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 14:59:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG nova.objects.instance [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'flavor' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:59:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:10 user nova-compute[74882]: INFO nova.compute.manager [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Attaching volume 1b864b3c-f072-405f-bf25-f24509e7ad47 to /dev/vdb
Nov 21 14:59:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:59:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=25.031513214111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG os_brick.utils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1962f408-4e24-4093-9fbe-6696ca2d76b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea338c9-eb05-43d2-bab3-2f0d9f9308ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3255a9fc-10c8-470d-a449-c4d8685718bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ae48a9-c1e4-4d11-851c-bea170ff3283]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 14:59:10 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a12c0c-2328-4fb7-b224-5b3e8d96829e]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG os_brick.utils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating existing volume attachment record: fc35e4b3-0dba-4e48-aa6e-f02275fed522 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 14:59:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbhPKZIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 14:59:16 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:59:16 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 14:59:16 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9f54ca-00a6-40c6-9d22-d5b52b3641d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 14:59:16 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e862740b-265a-4f05-acdf-fc688c28402a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47] added
Nov 21 14:59:16 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f832d30a-5227-4e5f-b648-1ff716f2137c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[57422315-508f-4aad-814c-42cd642e4227]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbhPKZIY {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tbhPKZIY" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7417b6-fdde-4989-81e1-cabfbb91401c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tbhPKZIY'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfad72df-ddf0-491d-b457-a9c48ac53cb7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d96a9cf-dacc-4404-9ca7-1d6c669510dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:59:16 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 14:59:16 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:59:16 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 14:59:16 user nova-compute[74882]: 
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0c0af-b466-4533-894a-9f2bd5bc2a6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260]
Nov 21 14:59:16 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260] successful.
Nov 21 14:59:16 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba9b248-0442-45e3-aa59-f5cbfe2918fd]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72b789c-0320-40e9-b719-edc835530735]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 (non-flash)
Nov 21 14:59:16 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 (non-flash)
Nov 21 14:59:16 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41c4a8e-83e1-415d-8f1e-7541f6bf078e]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 14:59:16 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbhPKZIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 14:59:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 14:59:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26133653565323563', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 14:59:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133653565323563', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 14:59:17 user nova-compute[74882]: DEBUG nova.objects.instance [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'flavor' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 14:59:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 14:59:17 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 14:59:17 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 14:59:17 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 14:59:17 user nova-compute[74882]:   <serial>1b864b3c-f072-405f-bf25-f24509e7ad47</serial>
Nov 21 14:59:17 user nova-compute[74882]: </disk>
Nov 21 14:59:17 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 14:59:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:59:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 14:59:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] No VIF found with MAC fa:16:3e:c1:48:fc, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 14:59:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-98093286-75b0-4a9f-8826-5b0df36faa48 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.770s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 14:59:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:59:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing instance network info cache due to event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:59:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:59:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:59:20 user nova-compute[74882]: DEBUG nova.network.neutron [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:59:21 user nova-compute[74882]: DEBUG nova.network.neutron [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated VIF entry in instance network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:59:21 user nova-compute[74882]: DEBUG nova.network.neutron [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:59:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4c53f06e-ee8b-438a-bff8-405c5ed177fa req-268f0897-7fa4-49e8-a936-5dccb9ba073c service nova] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:59:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 14:59:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG nova.compute.manager [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing instance network info cache due to event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:23 user nova-compute[74882]: INFO nova.compute.manager [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Rebooting instance
Nov 21 14:59:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated VIF entry in instance network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-04e4c61b-6fd5-4852-834b-0a356226b529 req-913f9161-bad5-4227-bcec-1d81074877a3 service nova] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 14:59:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 14:59:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 14:59:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-unplugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-unplugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:59:26 user nova-compute[74882]: WARNING nova.compute.manager [req-318fdec8-86ef-4914-adec-9689e6974454 req-4a3c9aaa-f74c-49ce-bff3-5739596ab011 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received unexpected event network-vif-unplugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with vm_state active and task_state reboot_started.
Nov 21 14:59:27 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance shutdown successfully.
Nov 21 14:59:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:59:29 user nova-compute[74882]: WARNING nova.compute.manager [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received unexpected event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with vm_state active and task_state reboot_started.
Nov 21 14:59:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG nova.compute.manager [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:59:29 user nova-compute[74882]: WARNING nova.compute.manager [req-d80e4bca-242c-441d-ada8-bc3277f32c35 req-8630a13d-33a9-4865-a66f-43153500a82c service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received unexpected event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with vm_state active and task_state reboot_started.
Nov 21 14:59:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:30 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance running successfully.
Nov 21 14:59:30 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance soft rebooted successfully.
Nov 21 14:59:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 14:59:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-0c259928-8f42-4794-ae11-3ddc74f7a17e tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.578s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 14:59:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 14:59:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 14:59:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 14:59:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 14:59:31 user nova-compute[74882]: WARNING nova.compute.manager [req-102358bd-85c1-4659-aea7-dc9f6327ab9a req-ba8e30b1-b4fc-4ef3-9ae6-e913cbf9525a service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received unexpected event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with vm_state active and task_state None.
Nov 21 14:59:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 14:59:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 14:59:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 14:59:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:00:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:00:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:00:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:00:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:00:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:00:06 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:00:07 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:00:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:00:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:00:08 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:00:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:00:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:00:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.021770477294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:00:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:00:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:00:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:00:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:00:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:00:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:01:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:01:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:01:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:01:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:01:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:01:06 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:01:07 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:01:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:01:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:01:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:01:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:01:10 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.021244049072266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 803e69ce-6100-4c41-b07d-4dbd19adc737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:01:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:01:12 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing instance network info cache due to event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG nova.network.neutron [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated VIF entry in instance network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0a89af14-1932-4bbe-bb76-ebd10d3c4dd9 req-15616f3f-ce03-4dd4-9775-9b16066ead46 service nova] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing instance network info cache due to event network-changed-c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Refreshing network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:01:16 user nova-compute[74882]: INFO nova.compute.manager [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Detaching volume 1b864b3c-f072-405f-bf25-f24509e7ad47
Nov 21 15:01:16 user nova-compute[74882]: INFO nova.virt.block_device [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Attempting to driver detach volume 1b864b3c-f072-405f-bf25-f24509e7ad47 from mountpoint /dev/vdb
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated VIF entry in instance network info cache for port c83ac310-48f6-4cf2-8a27-db58247270ba. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Attempting to detach device vdb from instance 803e69ce-6100-4c41-b07d-4dbd19adc737 from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 15:01:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:01:16 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:01:16 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:01:16 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:01:16 user nova-compute[74882]:   <serial>1b864b3c-f072-405f-bf25-f24509e7ad47</serial>
Nov 21 15:01:16 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:01:16 user nova-compute[74882]: </disk>
Nov 21 15:01:16 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:01:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-94971b20-254f-4faf-9f3e-5339a773bdef req-42d6d488-70bb-4cb8-8862-86111cde6079 service nova] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:01:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully detached device vdb from instance 803e69ce-6100-4c41-b07d-4dbd19adc737 from the persistent domain config.
Nov 21 15:01:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 803e69ce-6100-4c41-b07d-4dbd19adc737 from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 15:01:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:01:17 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:01:17 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:01:17 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:01:17 user nova-compute[74882]:   <serial>1b864b3c-f072-405f-bf25-f24509e7ad47</serial>
Nov 21 15:01:17 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:01:17 user nova-compute[74882]: </disk>
Nov 21 15:01:17 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:01:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 15:01:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:37 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 803e69ce-6100-4c41-b07d-4dbd19adc737 is timed out.
Nov 21 15:01:37 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully detached device vdb from instance 803e69ce-6100-4c41-b07d-4dbd19adc737 from the live domain config.
Nov 21 15:01:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tbhPKZIY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:01:37 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d85af6-76b9-45d7-a3d3-3ea3d5f7bbc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:01:37 user nova-compute[74882]: No targets found.
Nov 21 15:01:37 user nova-compute[74882]: iSNS:
Nov 21 15:01:37 user nova-compute[74882]: No targets found.
Nov 21 15:01:37 user nova-compute[74882]: STATIC:
Nov 21 15:01:37 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47
Nov 21 15:01:37 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:01:37 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:01:37 user nova-compute[74882]: FIRMWARE:
Nov 21 15:01:37 user nova-compute[74882]: No targets found.
Nov 21 15:01:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:01:37 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:01:37 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[79462897-e56c-4ecf-acfb-a6d67359cd9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb9753-b2b2-4e26-8400-09398de83965]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 (non-flash)
Nov 21 15:01:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 (non-flash)
Nov 21 15:01:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c5caf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2f2ea1-779b-43e4-9a6a-e098eacef268]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62ae808-51a7-41ce-bd2e-7f991393d4af]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e00c69-b1e1-4fa5-a057-50f6984c0b7b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee57577-9a67-4726-99df-c10c62d88361]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a10b62-3e72-4331-aace-5ce1d23f016b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc968a9-4166-418b-aae6-86147b6c014b]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260]
Nov 21 15:01:37 user nova-compute[74882]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47, portal: 172.16.0.220,3260] successful.
Nov 21 15:01:37 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b864b3c-f072-405f-bf25-f24509e7ad47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f32b4-31a2-44ec-a83c-ce39fb4b23e0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] <== disconnect_volume: return (321ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:01:37 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:01:38 user nova-compute[74882]: DEBUG nova.objects.instance [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'flavor' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:01:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-1a5d1310-d8f8-4c91-a4fb-f08e7a056976 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.190s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:01:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:01:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:01:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:02:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:02:06 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:02:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:02:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:02:06 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:02:06 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:02:07 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [{"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:02:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-803e69ce-6100-4c41-b07d-4dbd19adc737" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:02:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:02:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:02:10 user nova-compute[74882]: INFO nova.compute.manager [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Terminating instance
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-unplugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-unplugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-f964f398-f146-408f-90af-33125e78896f req-e706ad2c-85a1-4060-b989-1c600ddc6037 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-unplugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:02:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Instance destroyed successfully.
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lazy-loading 'resources' on Instance uuid 803e69ce-6100-4c41-b07d-4dbd19adc737 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T14:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1743715161',display_name='tempest-TestMinimumBasicScenario-server-1743715161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1743715161',id=45,image_ref='abe2b915-0cc6-49c0-93e0-40433a6f5990',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqeu5WaR9uaggnOaimLuzirOc8k7snoiRJ9ghk2/5FdDgSPtSEGnDDDIyc+tSFx6R3L3c4lkXOjG4ppgFcJ5TJ1N9RpnsciKPe0FWmpjaWHF1Xon+kpG+TCFMHQOa5oQQ==',key_name='tempest-TestMinimumBasicScenario-970885429',keypairs=<?>,launch_index=0,launched_at=2023-11-21T14:57:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddd03d02c8844c0fa58fa10c7c1dcbbc',ramdisk_id='',reservation_id='r-ncgcbeu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='abe2b915-0cc6-49c0-93e0-40433a6f5990',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-895289717',owner_user_name='tempest-TestMinimumBasicScenario-895289717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T14:59:31Z,user_data=None,user_id='e89a65d91d2f4dd9b1b143107b84d2b2',uuid=803e69ce-6100-4c41-b07d-4dbd19adc737,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converting VIF {"id": "c83ac310-48f6-4cf2-8a27-db58247270ba", "address": "fa:16:3e:c1:48:fc", "network": {"id": "6a1d901c-33bb-4608-93f8-525db0fd1706", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1691155781-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddd03d02c8844c0fa58fa10c7c1dcbbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83ac310-48", "ovs_interfaceid": "c83ac310-48f6-4cf2-8a27-db58247270ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=c83ac310-48f6-4cf2-8a27-db58247270ba,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83ac310-48') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:02:10 user nova-compute[74882]: DEBUG os_vif [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=c83ac310-48f6-4cf2-8a27-db58247270ba,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83ac310-48') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83ac310-48, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=127c2397-376a-4249-894e-160e2b86ac54) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:02:11 user nova-compute[74882]: INFO os_vif [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:48:fc,bridge_name='br-int',has_traffic_filtering=True,id=c83ac310-48f6-4cf2-8a27-db58247270ba,network=Network(6a1d901c-33bb-4608-93f8-525db0fd1706),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83ac310-48')
Nov 21 15:02:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Deleting instance files /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737_del
Nov 21 15:02:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Deletion of /opt/stack/data/nova/instances/803e69ce-6100-4c41-b07d-4dbd19adc737_del complete
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:11 user nova-compute[74882]: INFO nova.compute.manager [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:02:11 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Took 0.44 seconds to deallocate network for instance.
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:02:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:02:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:02:11 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=25.04840850830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.056s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:02:12 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Deleted allocations for instance 803e69ce-6100-4c41-b07d-4dbd19adc737
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ac3d3a14-c5b1-4136-aeb1-65bab8526209 tempest-TestMinimumBasicScenario-895289717 tempest-TestMinimumBasicScenario-895289717-project-member] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.944s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Acquiring lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] Lock "803e69ce-6100-4c41-b07d-4dbd19adc737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] No waiting events found dispatching network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:02:12 user nova-compute[74882]: WARNING nova.compute.manager [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received unexpected event network-vif-plugged-c83ac310-48f6-4cf2-8a27-db58247270ba for instance with vm_state deleted and task_state None.
Nov 21 15:02:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-e2ec0547-de3a-4c93-972b-dbdcb16656a6 req-8bc6f19e-1d10-4619-a7d8-a0a9d0825569 service nova] [instance: 803e69ce-6100-4c41-b07d-4dbd19adc737] Received event network-vif-deleted-c83ac310-48f6-4cf2-8a27-db58247270ba {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:02:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:02:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:02:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:02:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:02:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:02:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:02:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:02:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:02:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:02:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:02:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:02:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:02:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:02:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:03:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:03:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:03:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:03:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:03:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:03:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:12 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:03:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:03:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:03:13 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:03:14 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:03:14 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:03:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9131MB free_disk=25.086833953857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:03:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:03:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:03:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:03:26 user nova-compute[74882]: INFO nova.compute.claims [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Claim successful on node user
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.network.neutron [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:03:26 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.policy [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2dee138cf9464dba92c019fd5af90350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03633603b8ed4188a3a0ae67b1fea4f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:03:26 user nova-compute[74882]: INFO nova.virt.block_device [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Booting with volume 37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 at /dev/vda
Nov 21 15:03:26 user nova-compute[74882]: DEBUG os_brick.utils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb58ee6-8ff3-4d96-ba14-2e047c78c5e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cf45bb-b307-4b90-99ab-67d2d496b604]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb731ab-5b69-4057-b26a-03fa091f63c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdbc895-6e3b-44ba-93db-d6e9d2b3e1b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:03:26 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:03:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a4dfb8-64fc-49eb-a5e0-aab6f4fd39c3]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG os_brick.utils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:03:26 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating existing volume attachment record: 640ffc9a-e529-42ee-afdd-283eec09a3d7 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Successfully created port: 49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Successfully updated port: 49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG nova.compute.manager [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing instance network info cache due to event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:03:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG nova.network.neutron [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance network_info: |[{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG nova.network.neutron [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG nova.network.neutron [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated VIF entry in instance network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG nova.network.neutron [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:03:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d8e8d3f9-41b9-4053-b24a-3e4bd4d7291d req-3d669657-e9b2-4e11-8e9b-c5b0eac063f2 service nova] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:03:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:03:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Creating image(s)
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Ensure instance console log exists: /opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Start _get_guest_xml network_info=[{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27853f33-8925-42e4-b26d-7dfb27775c3d', 'attached_at': '', 'detached_at': '', 'volume_id': '37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'serial': '37ec0e7c-d846-40ba-ad23-9f6d42ceaee2'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '640ffc9a-e529-42ee-afdd-283eec09a3d7', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:03:34 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:03:34 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:03:34 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:03:34 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:03:34 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed52b9-1f30-40e7-8ff5-c14de8067306]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:03:34 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2667d830-a389-4b0e-9dc6-978481b8e8bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2] added
Nov 21 15:03:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c0ccdf-4ebb-423e-b325-8061faf7051c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b9f31a-7f45-46af-89c3-7f990d31c9ee]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzjIcRkt {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzjIcRkt" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c6d3bf-908d-4da7-9f5e-b5b2e4071c4b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzjIcRkt'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4095ebe-70e3-4e73-8ecc-93636d874b20]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1854c0-3bbd-4f57-aaa0-7f5335007af0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:03:34 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:03:34 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:03:34 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:03:34 user nova-compute[74882]: 
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[174602d3-0638-4d5f-bec3-e114d877514c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]
Nov 21 15:03:34 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.
Nov 21 15:03:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4361df93-3e00-4ebd-9773-370f7f3c5a37]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[56144e28-4496-4cd6-aaa2-47818be4bd44]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:03:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:03:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf33cc3-ab7a-41e9-aad4-3eaa5ef816a8]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:03:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23035656465666337', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035656465666337', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1138712177',display_name='tempest-TestShelveInstance-server-1138712177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1138712177',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZE4/uNRWzpLI+X8O5r2KGDJOs04FbB4yADRHY6qDBNc0WOLuElyTn92rTAvHSTsq2fFl5CwRDvSxUdKbEDZQXhcees7jGatDE+JKkHHR5bik1Jf1RJTEGJK70cFhP1cQ==',key_name='tempest-TestShelveInstance-1319781319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03633603b8ed4188a3a0ae67b1fea4f7',ramdisk_id='',reservation_id='r-yejiypxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1912646516',owner_user_name='tempest-TestShelveInstance-1912646516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:03:27Z,user_data=None,user_id='2dee138cf9464dba92c019fd5af90350',uuid=27853f33-8925-42e4-b26d-7dfb27775c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converting VIF {"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.objects.instance [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'pci_devices' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:03:35 user nova-compute[74882]:   <uuid>27853f33-8925-42e4-b26d-7dfb27775c3d</uuid>
Nov 21 15:03:35 user nova-compute[74882]:   <name>instance-0000002e</name>
Nov 21 15:03:35 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:03:35 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:03:35 user nova-compute[74882]:   <metadata>
Nov 21 15:03:35 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:03:35 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:03:35 user nova-compute[74882]:       <nova:name>tempest-TestShelveInstance-server-1138712177</nova:name>
Nov 21 15:03:35 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:03:34</nova:creationTime>
Nov 21 15:03:35 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:03:35 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:03:35 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:03:35 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:03:35 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:03:35 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:03:35 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:03:35 user nova-compute[74882]:       <nova:owner>
Nov 21 15:03:35 user nova-compute[74882]:         <nova:user uuid="2dee138cf9464dba92c019fd5af90350">tempest-TestShelveInstance-1912646516-project-member</nova:user>
Nov 21 15:03:35 user nova-compute[74882]:         <nova:project uuid="03633603b8ed4188a3a0ae67b1fea4f7">tempest-TestShelveInstance-1912646516</nova:project>
Nov 21 15:03:35 user nova-compute[74882]:       </nova:owner>
Nov 21 15:03:35 user nova-compute[74882]:       <nova:ports>
Nov 21 15:03:35 user nova-compute[74882]:         <nova:port uuid="49b968d1-8b3d-4af6-9267-8b51adc6e8bd">
Nov 21 15:03:35 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 15:03:35 user nova-compute[74882]:         </nova:port>
Nov 21 15:03:35 user nova-compute[74882]:       </nova:ports>
Nov 21 15:03:35 user nova-compute[74882]:     </nova:instance>
Nov 21 15:03:35 user nova-compute[74882]:   </metadata>
Nov 21 15:03:35 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:03:35 user nova-compute[74882]:     <system>
Nov 21 15:03:35 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:03:35 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:03:35 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:03:35 user nova-compute[74882]:       <entry name="serial">27853f33-8925-42e4-b26d-7dfb27775c3d</entry>
Nov 21 15:03:35 user nova-compute[74882]:       <entry name="uuid">27853f33-8925-42e4-b26d-7dfb27775c3d</entry>
Nov 21 15:03:35 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:03:35 user nova-compute[74882]:     </system>
Nov 21 15:03:35 user nova-compute[74882]:   </sysinfo>
Nov 21 15:03:35 user nova-compute[74882]:   <os>
Nov 21 15:03:35 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:03:35 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:03:35 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:03:35 user nova-compute[74882]:   </os>
Nov 21 15:03:35 user nova-compute[74882]:   <features>
Nov 21 15:03:35 user nova-compute[74882]:     <acpi/>
Nov 21 15:03:35 user nova-compute[74882]:     <apic/>
Nov 21 15:03:35 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:03:35 user nova-compute[74882]:   </features>
Nov 21 15:03:35 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:03:35 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:03:35 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:03:35 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:03:35 user nova-compute[74882]:   </clock>
Nov 21 15:03:35 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:03:35 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:03:35 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:03:35 user nova-compute[74882]:   </cpu>
Nov 21 15:03:35 user nova-compute[74882]:   <devices>
Nov 21 15:03:35 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:03:35 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:03:35 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 15:03:35 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:03:35 user nova-compute[74882]:       <serial>37ec0e7c-d846-40ba-ad23-9f6d42ceaee2</serial>
Nov 21 15:03:35 user nova-compute[74882]:     </disk>
Nov 21 15:03:35 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:03:35 user nova-compute[74882]:       <mac address="fa:16:3e:8b:e7:28"/>
Nov 21 15:03:35 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:03:35 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:03:35 user nova-compute[74882]:       <target dev="tap49b968d1-8b"/>
Nov 21 15:03:35 user nova-compute[74882]:     </interface>
Nov 21 15:03:35 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:03:35 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d/console.log" append="off"/>
Nov 21 15:03:35 user nova-compute[74882]:     </serial>
Nov 21 15:03:35 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:03:35 user nova-compute[74882]:     <video>
Nov 21 15:03:35 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:03:35 user nova-compute[74882]:     </video>
Nov 21 15:03:35 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:03:35 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:03:35 user nova-compute[74882]:     </rng>
Nov 21 15:03:35 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:03:35 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:03:35 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:03:35 user nova-compute[74882]:     </memballoon>
Nov 21 15:03:35 user nova-compute[74882]:   </devices>
Nov 21 15:03:35 user nova-compute[74882]: </domain>
Nov 21 15:03:35 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1138712177',display_name='tempest-TestShelveInstance-server-1138712177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1138712177',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZE4/uNRWzpLI+X8O5r2KGDJOs04FbB4yADRHY6qDBNc0WOLuElyTn92rTAvHSTsq2fFl5CwRDvSxUdKbEDZQXhcees7jGatDE+JKkHHR5bik1Jf1RJTEGJK70cFhP1cQ==',key_name='tempest-TestShelveInstance-1319781319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03633603b8ed4188a3a0ae67b1fea4f7',ramdisk_id='',reservation_id='r-yejiypxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1912646516',owner_user_name='tempest-TestShelveInstance-1912646516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:03:27Z,user_data=None,user_id='2dee138cf9464dba92c019fd5af90350',uuid=27853f33-8925-42e4-b26d-7dfb27775c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converting VIF {"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG os_vif [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd36f260e-38cb-50b3-b411-25456efb69df', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49b968d1-8b, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49b968d1-8b, col_values=(('qos', UUID('70b8e12c-3300-44a3-a83d-fadc64d682f8')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49b968d1-8b, col_values=(('external_ids', {'iface-id': '49b968d1-8b3d-4af6-9267-8b51adc6e8bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:e7:28', 'vm-uuid': '27853f33-8925-42e4-b26d-7dfb27775c3d'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:35 user nova-compute[74882]: INFO os_vif [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b')
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:03:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] No VIF found with MAC fa:16:3e:8b:e7:28, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:03:37 user nova-compute[74882]: WARNING nova.compute.manager [req-0c269c4c-9cdf-4a05-8c7a-a4d59da0cac2 req-45285187-cb9e-4f54-935e-dfcd0b7351b1 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state building and task_state spawning.
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:03:39 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance spawned successfully.
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:03:39 user nova-compute[74882]: INFO nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:03:39 user nova-compute[74882]: DEBUG nova.compute.manager [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:03:39 user nova-compute[74882]: WARNING nova.compute.manager [req-612d3cdd-0530-472f-8b0c-dd363cf036c3 req-e710366b-9771-4b1e-a3ac-984097e4932e service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state None.
Nov 21 15:03:39 user nova-compute[74882]: INFO nova.compute.manager [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Took 13.12 seconds to build instance.
Nov 21 15:03:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-754e55c9-c670-4cfe-aeba-c2dab759daae tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.225s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:03:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:03:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:04:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:06 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:04:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:04:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:04:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:04:07 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:04:07 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:04:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:04:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:04:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:04:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:08 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:12 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:04:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:04:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:04:13 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:04:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:04:14 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:04:14 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:04:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.084518432617188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 27853f33-8925-42e4-b26d-7dfb27775c3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:04:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:04:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:04:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:04:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 15:04:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 15:04:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:04:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:04:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:42 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 15:04:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:04:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:04:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:04:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:04:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:04:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 15:04:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:04:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:04:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:05:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:05:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:07 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:07 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:05:08 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:05:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:05:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:05:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:05:08 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:05:08 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:05:09 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:05:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:05:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:05:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:05:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:14 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:05:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:05:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:05:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.083972930908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 27853f33-8925-42e4-b26d-7dfb27775c3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing instance network info cache due to event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:05:17 user nova-compute[74882]: DEBUG nova.network.neutron [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:18 user nova-compute[74882]: INFO nova.compute.manager [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Shelve offloading
Nov 21 15:05:18 user nova-compute[74882]: DEBUG nova.network.neutron [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated VIF entry in instance network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG nova.network.neutron [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-6efe51ac-0455-4425-b05a-ececc21b7cd8 req-f5b6f782-0669-46ec-8cfd-985e7b52413a service nova] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:18 user nova-compute[74882]: DEBUG nova.compute.manager [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:05:18 user nova-compute[74882]: WARNING nova.compute.manager [req-c19000fb-b92c-4546-baba-91ec207e28a6 req-ee441d55-acc8-45d6-9269-179163e8c7a1 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state shelving.
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance destroyed successfully.
Nov 21 15:05:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG nova.network.neutron [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:05:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:20 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance destroyed successfully.
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'resources' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1138712177',display_name='tempest-TestShelveInstance-server-1138712177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1138712177',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZE4/uNRWzpLI+X8O5r2KGDJOs04FbB4yADRHY6qDBNc0WOLuElyTn92rTAvHSTsq2fFl5CwRDvSxUdKbEDZQXhcees7jGatDE+JKkHHR5bik1Jf1RJTEGJK70cFhP1cQ==',key_name='tempest-TestShelveInstance-1319781319',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03633603b8ed4188a3a0ae67b1fea4f7',ramdisk_id='',reservation_id='r-yejiypxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1912646516',owner_user_name='tempest-TestShelveInstance-1912646516-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:03:39Z,user_data=None,user_id='2dee138cf9464dba92c019fd5af90350',uuid=27853f33-8925-42e4-b26d-7dfb27775c3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converting VIF {"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_vif [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49b968d1-8b, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70b8e12c-3300-44a3-a83d-fadc64d682f8) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:20 user nova-compute[74882]: INFO os_vif [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b')
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:05:20 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f98ca-6168-48c5-a4aa-178598fd3f42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:05:20 user nova-compute[74882]: No targets found.
Nov 21 15:05:20 user nova-compute[74882]: iSNS:
Nov 21 15:05:20 user nova-compute[74882]: No targets found.
Nov 21 15:05:20 user nova-compute[74882]: STATIC:
Nov 21 15:05:20 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2
Nov 21 15:05:20 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:05:20 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:05:20 user nova-compute[74882]: FIRMWARE:
Nov 21 15:05:20 user nova-compute[74882]: No targets found.
Nov 21 15:05:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:05:20 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:05:20 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37c6137-d30d-48f5-bb13-042339d49ee7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2516c70-b8e3-42f9-ba1c-c3aeb976cfdb]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:05:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:05:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c1fdfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4fe48-d702-4e5c-abc3-800976e5e804]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f81c1-51df-4283-aeac-b10a1571c67a]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:05:20 user nova-compute[74882]: WARNING nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state shelving.
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:05:20 user nova-compute[74882]: WARNING nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state shelving.
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:05:20 user nova-compute[74882]: WARNING nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state shelving.
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:05:20 user nova-compute[74882]: WARNING nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state shelving.
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:05:20 user nova-compute[74882]: WARNING nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state shelving.
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing instance network info cache due to event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.network.neutron [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8f60a5-dd77-4f88-a0b4-7181082ab531]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff43f43-db9a-49f9-bc4a-d04e037b46b6]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2207bac1-e71c-4d5e-8172-a7453942c59f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f5dcd-82d4-4c20-81b4-139212914007]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]
Nov 21 15:05:20 user nova-compute[74882]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.
Nov 21 15:05:20 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fadd402-7ae3-49b7-89d3-702b8e259561]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] <== disconnect_volume: return (312ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:05:20 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:05:20 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Deleting instance files /opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d_del
Nov 21 15:05:20 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Deletion of /opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d_del complete
Nov 21 15:05:21 user nova-compute[74882]: DEBUG nova.network.neutron [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated VIF entry in instance network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:05:21 user nova-compute[74882]: DEBUG nova.network.neutron [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": null, "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap49b968d1-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:05:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-2002dab4-d1be-48e9-897e-755b3742a081 req-0998b6dd-ba48-4954-8e2e-072a22bd5577 service nova] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:05:21 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Deleted allocations for instance 27853f33-8925-42e4-b26d-7dfb27775c3d
Nov 21 15:05:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:05:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:05:21 user nova-compute[74882]: DEBUG nova.objects.instance [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'numa_topology' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:05:21 user nova-compute[74882]: DEBUG nova.objects.base [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Object Instance<27853f33-8925-42e4-b26d-7dfb27775c3d> lazy-loaded attributes: resources,numa_topology {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 15:05:22 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:05:22 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:05:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-ef8e87ca-8489-435c-b058-48a01ee50a08 tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.746s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:05:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:05:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:05:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:05:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:05:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:05:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:06:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:08 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:08 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:06:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:06:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:06:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:06:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:06:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:06:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:06:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=25.075199127197266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:06:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:06:16 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:06:16 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:06:16 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:06:16 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:06:16 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:06:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:06:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:06:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:06:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:06:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:06:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:06:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:06:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:07:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:07:09 user nova-compute[74882]: INFO nova.compute.manager [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Unshelving
Nov 21 15:07:09 user nova-compute[74882]: INFO nova.virt.block_device [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Booting with volume 37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 at /dev/vda
Nov 21 15:07:09 user nova-compute[74882]: DEBUG os_brick.utils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc475e30-3944-4168-925e-490ad9b04a23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c80eb64-f00b-4f6b-a5e8-6e0e65a5cbb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc0f46-264e-4516-9ab1-40ee80688576]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf112ec5-439d-4332-bd94-1324124b9ffe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:09 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:07:10 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:07:10 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ab2c0-b4c9-4537-8fed-015c2e055bb5]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG os_brick.utils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating existing volume attachment record: 36f79cb8-92e9-40f9-9850-3978036bdba6 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:07:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:07:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:07:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:07:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:07:12 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'pci_requests' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'numa_topology' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:07:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:07:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:07:15 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9124MB free_disk=25.07452392578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:07:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:07:15 user nova-compute[74882]: INFO nova.compute.claims [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Claim successful on node user
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.234s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:07:16 user nova-compute[74882]: INFO nova.network.neutron [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (f2c18da1-f4fd-49b6-a78a-043389a6ebfc): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:07:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing instance network info cache due to event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.network.neutron [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:07:17 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Creating image(s)
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Ensure instance console log exists: /opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Start _get_guest_xml network_info=[{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27853f33-8925-42e4-b26d-7dfb27775c3d', 'attached_at': '', 'detached_at': '', 'volume_id': '37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'serial': '37ec0e7c-d846-40ba-ad23-9f6d42ceaee2'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '36f79cb8-92e9-40f9-9850-3978036bdba6', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.network.neutron [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:07:17 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:07:17 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.objects.instance [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.objects.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Object Instance<27853f33-8925-42e4-b26d-7dfb27775c3d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:07:17 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:07:17 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:07:17 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2d5fd7-8fa2-4fcc-a812-8e7e4aa3c4a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:07:17 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe876c1-2f6b-4d8b-90d0-bd96680e29d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2] added
Nov 21 15:07:17 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c30d9-2013-419b-940b-2f6c68aeb7af]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285a589-4c86-4a11-a579-1181ad17e9c2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzjIcRkt {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzjIcRkt" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe3a542-353c-4b34-8bc7-3161f4963403]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzjIcRkt'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d08b804-2aaf-4f44-9545-3fc0c005e288]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[193769a0-66a0-4854-98ff-1c2fb0e374cf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:07:17 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:07:17 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:07:17 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:07:17 user nova-compute[74882]: 
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e2b7b8-3c46-41c7-aa37-eb40f26b017a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]
Nov 21 15:07:17 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.
Nov 21 15:07:17 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5b0ae-0612-4d6f-aa34-1909309225b3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f181c-bca2-4096-87e2-c9586f97d440]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:07:17 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:07:17 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5f5517-b373-4c6a-9ef5-87b8676c8c49]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.network.neutron [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated VIF entry in instance network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG nova.network.neutron [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:07:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-089c2806-f135-43f6-9cbf-0565ce8abe68 req-3a931cf9-4719-46d0-bc8d-c254dd7cfed6 service nova] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23035656465666337', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035656465666337', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T15:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1138712177',display_name='tempest-TestShelveInstance-server-1138712177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1138712177',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1319781319',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='03633603b8ed4188a3a0ae67b1fea4f7',ramdisk_id='',reservation_id='r-yejiypxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1912646516',owner_user_name='tempest-TestShelveInstance-1912646516-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:07:10Z,user_data=None,user_id='2dee138cf9464dba92c019fd5af90350',uuid=27853f33-8925-42e4-b26d-7dfb27775c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converting VIF {"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.objects.instance [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'pci_devices' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.objects.base [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Object Instance<27853f33-8925-42e4-b26d-7dfb27775c3d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74882) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:07:18 user nova-compute[74882]:   <uuid>27853f33-8925-42e4-b26d-7dfb27775c3d</uuid>
Nov 21 15:07:18 user nova-compute[74882]:   <name>instance-0000002e</name>
Nov 21 15:07:18 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:07:18 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:07:18 user nova-compute[74882]:   <metadata>
Nov 21 15:07:18 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:07:18 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:07:18 user nova-compute[74882]:       <nova:name>tempest-TestShelveInstance-server-1138712177</nova:name>
Nov 21 15:07:18 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:07:17</nova:creationTime>
Nov 21 15:07:18 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:07:18 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:07:18 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:07:18 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:07:18 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:07:18 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:07:18 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:07:18 user nova-compute[74882]:       <nova:owner>
Nov 21 15:07:18 user nova-compute[74882]:         <nova:user uuid="2dee138cf9464dba92c019fd5af90350">tempest-TestShelveInstance-1912646516-project-member</nova:user>
Nov 21 15:07:18 user nova-compute[74882]:         <nova:project uuid="03633603b8ed4188a3a0ae67b1fea4f7">tempest-TestShelveInstance-1912646516</nova:project>
Nov 21 15:07:18 user nova-compute[74882]:       </nova:owner>
Nov 21 15:07:18 user nova-compute[74882]:       <nova:ports>
Nov 21 15:07:18 user nova-compute[74882]:         <nova:port uuid="49b968d1-8b3d-4af6-9267-8b51adc6e8bd">
Nov 21 15:07:18 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 15:07:18 user nova-compute[74882]:         </nova:port>
Nov 21 15:07:18 user nova-compute[74882]:       </nova:ports>
Nov 21 15:07:18 user nova-compute[74882]:     </nova:instance>
Nov 21 15:07:18 user nova-compute[74882]:   </metadata>
Nov 21 15:07:18 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:07:18 user nova-compute[74882]:     <system>
Nov 21 15:07:18 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:07:18 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:07:18 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:07:18 user nova-compute[74882]:       <entry name="serial">27853f33-8925-42e4-b26d-7dfb27775c3d</entry>
Nov 21 15:07:18 user nova-compute[74882]:       <entry name="uuid">27853f33-8925-42e4-b26d-7dfb27775c3d</entry>
Nov 21 15:07:18 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:07:18 user nova-compute[74882]:     </system>
Nov 21 15:07:18 user nova-compute[74882]:   </sysinfo>
Nov 21 15:07:18 user nova-compute[74882]:   <os>
Nov 21 15:07:18 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:07:18 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:07:18 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:07:18 user nova-compute[74882]:   </os>
Nov 21 15:07:18 user nova-compute[74882]:   <features>
Nov 21 15:07:18 user nova-compute[74882]:     <acpi/>
Nov 21 15:07:18 user nova-compute[74882]:     <apic/>
Nov 21 15:07:18 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:07:18 user nova-compute[74882]:   </features>
Nov 21 15:07:18 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:07:18 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:07:18 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:07:18 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:07:18 user nova-compute[74882]:   </clock>
Nov 21 15:07:18 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:07:18 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:07:18 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:07:18 user nova-compute[74882]:   </cpu>
Nov 21 15:07:18 user nova-compute[74882]:   <devices>
Nov 21 15:07:18 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:07:18 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:07:18 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 15:07:18 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:07:18 user nova-compute[74882]:       <serial>37ec0e7c-d846-40ba-ad23-9f6d42ceaee2</serial>
Nov 21 15:07:18 user nova-compute[74882]:     </disk>
Nov 21 15:07:18 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:07:18 user nova-compute[74882]:       <mac address="fa:16:3e:8b:e7:28"/>
Nov 21 15:07:18 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:07:18 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:07:18 user nova-compute[74882]:       <target dev="tap49b968d1-8b"/>
Nov 21 15:07:18 user nova-compute[74882]:     </interface>
Nov 21 15:07:18 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:07:18 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d/console.log" append="off"/>
Nov 21 15:07:18 user nova-compute[74882]:     </serial>
Nov 21 15:07:18 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:07:18 user nova-compute[74882]:     <video>
Nov 21 15:07:18 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:07:18 user nova-compute[74882]:     </video>
Nov 21 15:07:18 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:07:18 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:07:18 user nova-compute[74882]:     </rng>
Nov 21 15:07:18 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:07:18 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:07:18 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:07:18 user nova-compute[74882]:     </memballoon>
Nov 21 15:07:18 user nova-compute[74882]:   </devices>
Nov 21 15:07:18 user nova-compute[74882]: </domain>
Nov 21 15:07:18 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T15:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1138712177',display_name='tempest-TestShelveInstance-server-1138712177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1138712177',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1319781319',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='03633603b8ed4188a3a0ae67b1fea4f7',ramdisk_id='',reservation_id='r-yejiypxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1912646516',owner_user_name='tempest-TestShelveInstance-1912646516-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:07:10Z,user_data=None,user_id='2dee138cf9464dba92c019fd5af90350',uuid=27853f33-8925-42e4-b26d-7dfb27775c3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converting VIF {"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG os_vif [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd36f260e-38cb-50b3-b411-25456efb69df', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49b968d1-8b, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49b968d1-8b, col_values=(('qos', UUID('b1fb2a9b-4a7d-4ada-a55f-661875e3a079')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49b968d1-8b, col_values=(('external_ids', {'iface-id': '49b968d1-8b3d-4af6-9267-8b51adc6e8bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:e7:28', 'vm-uuid': '27853f33-8925-42e4-b26d-7dfb27775c3d'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:18 user nova-compute[74882]: INFO os_vif [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b')
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:07:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] No VIF found with MAC fa:16:3e:8b:e7:28, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:07:19 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG nova.compute.manager [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:07:20 user nova-compute[74882]: WARNING nova.compute.manager [req-3f3f655f-c9e6-4b2a-a993-7e5557f33f12 req-4605ee1f-0ec3-4b56-8fae-2e875ced5646 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 21 15:07:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:07:22 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance spawned successfully.
Nov 21 15:07:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-db464cb5-4870-4e6e-b19a-75d523ed0caa tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.554s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:07:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:07:22 user nova-compute[74882]: WARNING nova.compute.manager [req-a0c6b113-022a-495d-a4b1-66498879a9b7 req-e313d286-7ea8-47ea-a756-bb39bf58a6c9 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state active and task_state None.
Nov 21 15:07:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:07:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:07:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:07:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:07:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:07:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:07:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:07:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:07:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:07:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:08:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:08:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:08:12 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:08:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:08:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:08:12 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:08:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:08:12 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:08:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:08:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:08:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:08:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:08:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:08:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:08:17 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:08:17 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:08:18 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:08:18 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:08:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.073081970214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 27853f33-8925-42e4-b26d-7dfb27775c3d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:19 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:19 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:08:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:08:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:08:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:08:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:08:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:08:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:08:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG nova.compute.manager [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing instance network info cache due to event network-changed-49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Acquiring lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Acquired lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG nova.network.neutron [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Refreshing network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:00 user nova-compute[74882]: INFO nova.compute.manager [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Terminating instance
Nov 21 15:09:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Instance destroyed successfully.
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.objects.instance [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lazy-loading 'resources' on Instance uuid 27853f33-8925-42e4-b26d-7dfb27775c3d {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-21T15:03:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1138712177',display_name='tempest-TestShelveInstance-server-1138712177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1138712177',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZE4/uNRWzpLI+X8O5r2KGDJOs04FbB4yADRHY6qDBNc0WOLuElyTn92rTAvHSTsq2fFl5CwRDvSxUdKbEDZQXhcees7jGatDE+JKkHHR5bik1Jf1RJTEGJK70cFhP1cQ==',key_name='tempest-TestShelveInstance-1319781319',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03633603b8ed4188a3a0ae67b1fea4f7',ramdisk_id='',reservation_id='r-yejiypxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1912646516',owner_user_name='tempest-TestShelveInstance-1912646516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:07:22Z,user_data=None,user_id='2dee138cf9464dba92c019fd5af90350',uuid=27853f33-8925-42e4-b26d-7dfb27775c3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converting VIF {"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_vif [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49b968d1-8b, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1fb2a9b-4a7d-4ada-a55f-661875e3a079) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:01 user nova-compute[74882]: INFO os_vif [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:e7:28,bridge_name='br-int',has_traffic_filtering=True,id=49b968d1-8b3d-4af6-9267-8b51adc6e8bd,network=Network(c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49b968d1-8b')
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzjIcRkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:09:01 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[53795de6-2435-4ffb-9162-c62b1a338a63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:09:01 user nova-compute[74882]: No targets found.
Nov 21 15:09:01 user nova-compute[74882]: iSNS:
Nov 21 15:09:01 user nova-compute[74882]: No targets found.
Nov 21 15:09:01 user nova-compute[74882]: STATIC:
Nov 21 15:09:01 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2
Nov 21 15:09:01 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:09:01 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:09:01 user nova-compute[74882]: FIRMWARE:
Nov 21 15:09:01 user nova-compute[74882]: No targets found.
Nov 21 15:09:01 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:09:01 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:09:01 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063a630-2139-468f-9060-3f4f8ffa318a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b5dee7-1514-46d8-a190-46773e6e7e47]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:09:01 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 (non-flash)
Nov 21 15:09:01 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c557760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a552cc3a-a184-49c8-bb56-0095709d152e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc66945-bd0a-44be-b061-2fa339593c99]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-9eb330e9-5632-4171-8a71-09e359c1aab4 req-20d17146-4395-4ec6-95a4-c09a102dc033 service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-unplugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff341dc8-548f-47e1-b7ee-e40b5247d862]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f662c0-a487-49f1-9247-ca32ef31c7da]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[db430198-dcfc-41d7-81e3-82d49f8f06a7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updated VIF entry in instance network info cache for port 49b968d1-8b3d-4af6-9267-8b51adc6e8bd. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.network.neutron [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [{"id": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "address": "fa:16:3e:8b:e7:28", "network": {"id": "c8b93bf3-5e7f-4e2b-9bd8-8dc0c8127e28", "bridge": "br-int", "label": "tempest-TestShelveInstance-661320618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03633603b8ed4188a3a0ae67b1fea4f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49b968d1-8b", "ovs_interfaceid": "49b968d1-8b3d-4af6-9267-8b51adc6e8bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c9a25ca2-b50c-400f-9acc-d497cff999dc req-593c87ef-e7bc-4c95-be81-2fa70144e15f service nova] Releasing lock "refresh_cache-27853f33-8925-42e4-b26d-7dfb27775c3d" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0dd7f2-9dd7-4004-a9be-0fc0f6ea6d6c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260]
Nov 21 15:09:01 user nova-compute[74882]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2, portal: 172.16.0.220,3260] successful.
Nov 21 15:09:01 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2381c98f-8f9c-444c-a33e-e0a8e4300425]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] <== disconnect_volume: return (345ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:09:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Deleting instance files /opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d_del
Nov 21 15:09:01 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Deletion of /opt/stack/data/nova/instances/27853f33-8925-42e4-b26d-7dfb27775c3d_del complete
Nov 21 15:09:01 user nova-compute[74882]: INFO nova.compute.manager [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 21 15:09:01 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:09:01 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:09:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:02 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:09:02 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Took 0.71 seconds to deallocate network for instance.
Nov 21 15:09:03 user nova-compute[74882]: INFO nova.compute.manager [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Took 0.71 seconds to detach 1 volumes for instance.
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Deleting volume: 37ec0e7c-d846-40ba-ad23-9f6d42ceaee2 {{(pid=74882) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:03 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Deleted allocations for instance 27853f33-8925-42e4-b26d-7dfb27775c3d
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-14cd58f5-ccc5-4c1c-8c92-20b03707c97c tempest-TestShelveInstance-1912646516 tempest-TestShelveInstance-1912646516-project-member] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.975s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:09:03 user nova-compute[74882]: WARNING nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state deleted and task_state None.
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:09:03 user nova-compute[74882]: WARNING nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state deleted and task_state None.
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Acquiring lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] Lock "27853f33-8925-42e4-b26d-7dfb27775c3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] No waiting events found dispatching network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:09:03 user nova-compute[74882]: WARNING nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received unexpected event network-vif-plugged-49b968d1-8b3d-4af6-9267-8b51adc6e8bd for instance with vm_state deleted and task_state None.
Nov 21 15:09:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-95a9d01e-0454-4a99-950f-e1fd80daa27d req-fb7cde3c-e985-42e0-84fc-e4152f198d1d service nova] [instance: 27853f33-8925-42e4-b26d-7dfb27775c3d] Received event network-vif-deleted-49b968d1-8b3d-4af6-9267-8b51adc6e8bd {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:09:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:09:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:09:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:09:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:09:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:09:17 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:09:17 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:09:17 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9103MB free_disk=25.072208404541016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:09:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:09:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:09:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:09:18 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:09:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:09:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:09:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 15:09:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 15:09:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:09:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:09:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:09:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:09:51 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 15:09:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:09:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:10 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:12 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:12 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:10:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:10:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:10:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:10:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:10:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:10:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:10:17 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:10:17 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:10:17 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:10:17 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9126MB free_disk=25.070209503173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:10:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:10:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:10:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "e7762f03-419c-428d-8fa9-c1e4f46360dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:10:20 user nova-compute[74882]: INFO nova.compute.claims [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Claim successful on node user
Nov 21 15:10:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:10:20 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:10:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:20 user nova-compute[74882]: INFO nova.virt.block_device [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Booting with volume snapshot cf7ab194-1a1a-4844-96fc-b902f6e7e415 at /dev/vda
Nov 21 15:10:20 user nova-compute[74882]: DEBUG nova.policy [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:10:21 user nova-compute[74882]: DEBUG nova.network.neutron [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Successfully created port: 21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:10:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Successfully updated port: 21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquired lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received event network-changed-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.compute.manager [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Refreshing instance network info cache due to event network-changed-21baf7bf-7bbb-426e-9931-99d21c588806. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Acquiring lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.network.neutron [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Updating instance_info_cache with network_info: [{"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Releasing lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Instance network_info: |[{"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Acquired lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:10:22 user nova-compute[74882]: DEBUG nova.network.neutron [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Refreshing network info cache for port 21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:10:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Updated VIF entry in instance network info cache for port 21baf7bf-7bbb-426e-9931-99d21c588806. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:10:23 user nova-compute[74882]: DEBUG nova.network.neutron [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Updating instance_info_cache with network_info: [{"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:10:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-df882ef5-78e7-4dce-92ad-bb84c9be216a req-86d07c40-c941-4993-9dcc-26c91a6e5737 service nova] Releasing lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:10:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG os_brick.utils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cd6352-178b-4f6b-8c1e-760f6baffb01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b994ebb-e987-4c93-9d0f-16c69df155cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba0538-affc-41f3-bc8f-a02456a76ba1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c08e42-e705-479b-897a-48f282679d4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:10:26 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:10:26 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a345da-ed8e-451e-9b75-3d5be2ca40c5]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG os_brick.utils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Updating existing volume attachment record: 4d9ff121-8a1b-4e06-aa25-bb5edf611b60 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:10:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:10:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:10:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:10:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:10:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:10:32 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Creating image(s)
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Ensure instance console log exists: /opt/stack/data/nova/instances/e7762f03-419c-428d-8fa9-c1e4f46360dd/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Start _get_guest_xml network_info=[{"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mgvnEWyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7762f03-419c-428d-8fa9-c1e4f46360dd', 'attached_at': '', 'detached_at': '', 'volume_id': '9c111644-ee18-4af0-ba4f-12bf99aa32e5', 'serial': '9c111644-ee18-4af0-ba4f-12bf99aa32e5'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '4d9ff121-8a1b-4e06-aa25-bb5edf611b60', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:10:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:10:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mgvnEWyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:10:32 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:10:32 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:10:32 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3ff840-85ae-4178-8198-078a313f2676]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:10:32 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc70d1-dbdd-45a0-8541-98c9778f3ef9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5] added
Nov 21 15:10:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[858f45f5-bc17-4964-8628-f3508ce88e1f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[825235bb-07f0-4402-bc25-31296011c39c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mgvnEWyM {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mgvnEWyM" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05756d4-e672-4a28-a291-b5b061ad4fa8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mgvnEWyM'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211247b-d51b-4b85-bb32-554dfdd26573]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caa24b9-8a0c-429f-929b-4b2a99bf7735]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:10:32 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:10:32 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:10:32 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:10:32 user nova-compute[74882]: 
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b39cc7-e2ad-4654-9181-7bb2ca7d2737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260]
Nov 21 15:10:32 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260] successful.
Nov 21 15:10:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d9f8d6-e9c7-4243-947e-5f3d33fbd1c4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a95bcd-6fbd-4676-a750-a9817327c77d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 (non-flash)
Nov 21 15:10:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 (non-flash)
Nov 21 15:10:32 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e856d6f4-eb30-4a14-ac1c-c4ffa940944b]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:10:32 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mgvnEWyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26565636138376166', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565636138376166', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1182419022',display_name='tempest-TestVolumeBootPattern-server-1182419022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1182419022',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-up6pfbse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:10:21Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=e7762f03-419c-428d-8fa9-c1e4f46360dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:54,bridge_name='br-int',has_traffic_filtering=True,id=21baf7bf-7bbb-426e-9931-99d21c588806,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21baf7bf-7b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'pci_devices' on Instance uuid e7762f03-419c-428d-8fa9-c1e4f46360dd {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:10:33 user nova-compute[74882]:   <uuid>e7762f03-419c-428d-8fa9-c1e4f46360dd</uuid>
Nov 21 15:10:33 user nova-compute[74882]:   <name>instance-0000002f</name>
Nov 21 15:10:33 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:10:33 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:10:33 user nova-compute[74882]:   <metadata>
Nov 21 15:10:33 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:10:33 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:10:33 user nova-compute[74882]:       <nova:name>tempest-TestVolumeBootPattern-server-1182419022</nova:name>
Nov 21 15:10:33 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:10:32</nova:creationTime>
Nov 21 15:10:33 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:10:33 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:10:33 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:10:33 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:10:33 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:10:33 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:10:33 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:10:33 user nova-compute[74882]:       <nova:owner>
Nov 21 15:10:33 user nova-compute[74882]:         <nova:user uuid="27e5950baa034e029e5db136635acd29">tempest-TestVolumeBootPattern-2100428844-project-member</nova:user>
Nov 21 15:10:33 user nova-compute[74882]:         <nova:project uuid="52b11227090b4d16929bdc1b9d2e8c16">tempest-TestVolumeBootPattern-2100428844</nova:project>
Nov 21 15:10:33 user nova-compute[74882]:       </nova:owner>
Nov 21 15:10:33 user nova-compute[74882]:       <nova:ports>
Nov 21 15:10:33 user nova-compute[74882]:         <nova:port uuid="21baf7bf-7bbb-426e-9931-99d21c588806">
Nov 21 15:10:33 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 21 15:10:33 user nova-compute[74882]:         </nova:port>
Nov 21 15:10:33 user nova-compute[74882]:       </nova:ports>
Nov 21 15:10:33 user nova-compute[74882]:     </nova:instance>
Nov 21 15:10:33 user nova-compute[74882]:   </metadata>
Nov 21 15:10:33 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:10:33 user nova-compute[74882]:     <system>
Nov 21 15:10:33 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:10:33 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:10:33 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:10:33 user nova-compute[74882]:       <entry name="serial">e7762f03-419c-428d-8fa9-c1e4f46360dd</entry>
Nov 21 15:10:33 user nova-compute[74882]:       <entry name="uuid">e7762f03-419c-428d-8fa9-c1e4f46360dd</entry>
Nov 21 15:10:33 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:10:33 user nova-compute[74882]:     </system>
Nov 21 15:10:33 user nova-compute[74882]:   </sysinfo>
Nov 21 15:10:33 user nova-compute[74882]:   <os>
Nov 21 15:10:33 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:10:33 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:10:33 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:10:33 user nova-compute[74882]:   </os>
Nov 21 15:10:33 user nova-compute[74882]:   <features>
Nov 21 15:10:33 user nova-compute[74882]:     <acpi/>
Nov 21 15:10:33 user nova-compute[74882]:     <apic/>
Nov 21 15:10:33 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:10:33 user nova-compute[74882]:   </features>
Nov 21 15:10:33 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:10:33 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:10:33 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:10:33 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:10:33 user nova-compute[74882]:   </clock>
Nov 21 15:10:33 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:10:33 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:10:33 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:10:33 user nova-compute[74882]:   </cpu>
Nov 21 15:10:33 user nova-compute[74882]:   <devices>
Nov 21 15:10:33 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:10:33 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:10:33 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 15:10:33 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:10:33 user nova-compute[74882]:       <serial>9c111644-ee18-4af0-ba4f-12bf99aa32e5</serial>
Nov 21 15:10:33 user nova-compute[74882]:     </disk>
Nov 21 15:10:33 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:10:33 user nova-compute[74882]:       <mac address="fa:16:3e:4d:61:54"/>
Nov 21 15:10:33 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:10:33 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:10:33 user nova-compute[74882]:       <target dev="tap21baf7bf-7b"/>
Nov 21 15:10:33 user nova-compute[74882]:     </interface>
Nov 21 15:10:33 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:10:33 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/e7762f03-419c-428d-8fa9-c1e4f46360dd/console.log" append="off"/>
Nov 21 15:10:33 user nova-compute[74882]:     </serial>
Nov 21 15:10:33 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:10:33 user nova-compute[74882]:     <video>
Nov 21 15:10:33 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:10:33 user nova-compute[74882]:     </video>
Nov 21 15:10:33 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:10:33 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:10:33 user nova-compute[74882]:     </rng>
Nov 21 15:10:33 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:10:33 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:10:33 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:10:33 user nova-compute[74882]:     </memballoon>
Nov 21 15:10:33 user nova-compute[74882]:   </devices>
Nov 21 15:10:33 user nova-compute[74882]: </domain>
Nov 21 15:10:33 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1182419022',display_name='tempest-TestVolumeBootPattern-server-1182419022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1182419022',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-up6pfbse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:10:21Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=e7762f03-419c-428d-8fa9-c1e4f46360dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:54,bridge_name='br-int',has_traffic_filtering=True,id=21baf7bf-7bbb-426e-9931-99d21c588806,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21baf7bf-7b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG os_vif [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:54,bridge_name='br-int',has_traffic_filtering=True,id=21baf7bf-7bbb-426e-9931-99d21c588806,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21baf7bf-7b') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c019b773-d9c4-5755-ba8d-598e9ab19425', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21baf7bf-7b, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21baf7bf-7b, col_values=(('qos', UUID('f05ffa35-30ff-478f-a2e1-6c06bcd68a51')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21baf7bf-7b, col_values=(('external_ids', {'iface-id': '21baf7bf-7bbb-426e-9931-99d21c588806', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:61:54', 'vm-uuid': 'e7762f03-419c-428d-8fa9-c1e4f46360dd'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:33 user nova-compute[74882]: INFO os_vif [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:54,bridge_name='br-int',has_traffic_filtering=True,id=21baf7bf-7bbb-426e-9931-99d21c588806,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21baf7bf-7b')
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:10:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No VIF found with MAC fa:16:3e:4d:61:54, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:10:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received event network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:10:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Acquiring lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:10:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:10:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:10:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] No waiting events found dispatching network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:10:35 user nova-compute[74882]: WARNING nova.compute.manager [req-78c9d190-eaaf-405a-8b05-2d4ffbe0ad1f req-536873a7-d1c2-46c2-b084-7ba4a7d93bbf service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received unexpected event network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 for instance with vm_state building and task_state spawning.
Nov 21 15:10:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:10:36 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Instance spawned successfully.
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:10:36 user nova-compute[74882]: INFO nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 21 15:10:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:10:36 user nova-compute[74882]: INFO nova.compute.manager [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Took 16.77 seconds to build instance.
Nov 21 15:10:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7740619a-83ca-41ae-aeaf-4e2f62cd34d3 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.858s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:10:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received event network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:10:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Acquiring lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:10:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:10:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:10:37 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] No waiting events found dispatching network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:10:37 user nova-compute[74882]: WARNING nova.compute.manager [req-0c491009-f51b-48c7-b4ca-4dce037435a0 req-69600d32-e9ce-4afe-a217-30eb441ba9cd service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received unexpected event network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 for instance with vm_state active and task_state None.
Nov 21 15:10:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:10:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:10:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:10:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:10:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:10:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:11 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:11:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:11:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:11:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:11:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:11:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:11:16 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid e7762f03-419c-428d-8fa9-c1e4f46360dd {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:11:17 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Updating instance_info_cache with network_info: [{"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:11:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-e7762f03-419c-428d-8fa9-c1e4f46360dd" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:11:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:11:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:11:18 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:11:19 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:11:19 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:11:19 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.060558319091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance e7762f03-419c-428d-8fa9-c1e4f46360dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:11:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:11:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:11:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:11:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:11:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:11:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:11:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:12:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:12:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:12:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "e7762f03-419c-428d-8fa9-c1e4f46360dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:12:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:12:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:12:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:12:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:12:10 user nova-compute[74882]: INFO nova.compute.manager [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Terminating instance
Nov 21 15:12:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:12:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received event network-vif-unplugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Acquiring lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] No waiting events found dispatching network-vif-unplugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.compute.manager [req-0652b8fe-f788-4908-a8ad-e74c1c89645d req-765dae3e-9853-459a-92b4-5fa65f8425b8 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received event network-vif-unplugged-21baf7bf-7bbb-426e-9931-99d21c588806 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Instance destroyed successfully.
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.objects.instance [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'resources' on Instance uuid e7762f03-419c-428d-8fa9-c1e4f46360dd {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1182419022',display_name='tempest-TestVolumeBootPattern-server-1182419022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1182419022',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-up6pfbse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:10:37Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=e7762f03-419c-428d-8fa9-c1e4f46360dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "21baf7bf-7bbb-426e-9931-99d21c588806", "address": "fa:16:3e:4d:61:54", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21baf7bf-7b", "ovs_interfaceid": "21baf7bf-7bbb-426e-9931-99d21c588806", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:61:54,bridge_name='br-int',has_traffic_filtering=True,id=21baf7bf-7bbb-426e-9931-99d21c588806,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21baf7bf-7b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_vif [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:61:54,bridge_name='br-int',has_traffic_filtering=True,id=21baf7bf-7bbb-426e-9931-99d21c588806,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21baf7bf-7b') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21baf7bf-7b, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f05ffa35-30ff-478f-a2e1-6c06bcd68a51) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:11 user nova-compute[74882]: INFO os_vif [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:61:54,bridge_name='br-int',has_traffic_filtering=True,id=21baf7bf-7bbb-426e-9931-99d21c588806,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21baf7bf-7b')
Nov 21 15:12:11 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mgvnEWyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:12:11 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e0cda-3c2f-4dc6-92eb-03e2f0aa46e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:12:11 user nova-compute[74882]: No targets found.
Nov 21 15:12:11 user nova-compute[74882]: iSNS:
Nov 21 15:12:11 user nova-compute[74882]: No targets found.
Nov 21 15:12:11 user nova-compute[74882]: STATIC:
Nov 21 15:12:11 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5
Nov 21 15:12:11 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:12:11 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:12:11 user nova-compute[74882]: FIRMWARE:
Nov 21 15:12:11 user nova-compute[74882]: No targets found.
Nov 21 15:12:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:12:11 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:12:11 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f39206-aedb-4c58-ad9b-3129d021f63c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e57126-d527-4eb3-a02c-47452d9d5a5e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 (non-flash)
Nov 21 15:12:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 (non-flash)
Nov 21 15:12:11 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c4bfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a55d9ad-aa3c-44cd-99e9-1ab8010caeae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2be581-b490-43c4-83ad-2e93d5190285]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[110f0a0c-f43e-4792-afe1-c6646aeae88b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[95033182-0183-4284-a695-e7d7f589b713]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4b2a323e', '/dev/disk/by-id/scsi-1SCST_BIO4b2a323e-eeca87af1ed9fe9b', '/dev/disk/by-id/scsi-26565636138376166') {{(pid=85964) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d17a58-166f-467c-bfeb-564d74737a35]: (4, None) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f944c3-b57d-41ea-af31-206664a075bb]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:12:11 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[300eec90-5d11-4124-9e19-ba252d19b60d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260]
Nov 21 15:12:12 user nova-compute[74882]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5, portal: 172.16.0.220,3260] successful.
Nov 21 15:12:12 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c111644-ee18-4af0-ba4f-12bf99aa32e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e0007e-12b0-495e-b36c-fcf8171c0d64]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== disconnect_volume: return (284ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:12:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Deleting instance files /opt/stack/data/nova/instances/e7762f03-419c-428d-8fa9-c1e4f46360dd_del
Nov 21 15:12:12 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Deletion of /opt/stack/data/nova/instances/e7762f03-419c-428d-8fa9-c1e4f46360dd_del complete
Nov 21 15:12:12 user nova-compute[74882]: INFO nova.compute.manager [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 21 15:12:12 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:12:12 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:12:12 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Took 0.48 seconds to deallocate network for instance.
Nov 21 15:12:12 user nova-compute[74882]: DEBUG nova.compute.manager [req-1581b7af-d868-4bb7-92b0-2fda36ad208d req-58e935b9-0caf-444e-8e3b-2fd13eb92f1b service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received event network-vif-deleted-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received event network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Acquiring lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] No waiting events found dispatching network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:12:13 user nova-compute[74882]: WARNING nova.compute.manager [req-45ee56ff-dab8-4af3-9f1e-a6dc0da6def1 req-cad413e4-3734-4b19-8506-f1a8c758ced1 service nova] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Received unexpected event network-vif-plugged-21baf7bf-7bbb-426e-9931-99d21c588806 for instance with vm_state active and task_state deleting.
Nov 21 15:12:13 user nova-compute[74882]: INFO nova.compute.manager [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Took 0.82 seconds to detach 1 volumes for instance.
Nov 21 15:12:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: e7762f03-419c-428d-8fa9-c1e4f46360dd] Deleting volume: 9c111644-ee18-4af0-ba4f-12bf99aa32e5 {{(pid=74882) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:12:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:12:13 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Deleted allocations for instance e7762f03-419c-428d-8fa9-c1e4f46360dd
Nov 21 15:12:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-45ae1504-6b87-4e5c-bcc9-a5c26274dd9b tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "e7762f03-419c-428d-8fa9-c1e4f46360dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.080s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:12:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:14 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:12:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:12:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:12:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:12:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:12:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:12:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:12:20 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:12:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:12:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:12:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9099MB free_disk=25.059757232666016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:12:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:12:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:12:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:12:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:12:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:12:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:12:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:12:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:12:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:12:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:13:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:13:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:14 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:13:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:13:15 user nova-compute[74882]: INFO nova.compute.claims [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Claim successful on node user
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:13:15 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.policy [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:13:15 user nova-compute[74882]: INFO nova.virt.block_device [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Booting with volume 80a6a968-8bac-42a1-ab9f-f143b76c8677 at /dev/vda
Nov 21 15:13:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffec3e1-2f6f-4bc8-88d1-9704228858af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6c8ec3-185f-4fd7-ae1a-c7667ea6e592]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[04902836-193f-4194-857b-4570558f622a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5786a44-0217-45d9-abb6-95a05bb54f23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:13:15 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:13:15 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bd618c-4a69-48d8-96ba-25d53b84eea0]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG os_brick.utils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:13:15 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating existing volume attachment record: 68a47d4e-aa06-4b85-a6b8-59827082222c {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Successfully created port: 12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Successfully updated port: 12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquired lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-changed-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.compute.manager [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Refreshing instance network info cache due to event network-changed-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Acquiring lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:16 user nova-compute[74882]: DEBUG nova.network.neutron [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating instance_info_cache with network_info: [{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Releasing lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Instance network_info: |[{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Acquired lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.network.neutron [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Refreshing network info cache for port 12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.network.neutron [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updated VIF entry in instance network info cache for port 12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.network.neutron [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating instance_info_cache with network_info: [{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a86a90be-bd0a-449a-88a8-c0c4b19eee19 req-71924905-6093-4228-b0b6-9daa35abd4b0 service nova] Releasing lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Skipping network cache update for instance because it is Building. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:13:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:13:21 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Creating image(s)
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Ensure instance console log exists: /opt/stack/data/nova/instances/15e4f63e-87bc-4e34-8200-6290d2f2fbf6/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Start _get_guest_xml network_info=[{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Wkvfecgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15e4f63e-87bc-4e34-8200-6290d2f2fbf6', 'attached_at': '', 'detached_at': '', 'volume_id': '80a6a968-8bac-42a1-ab9f-f143b76c8677', 'serial': '80a6a968-8bac-42a1-ab9f-f143b76c8677'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '68a47d4e-aa06-4b85-a6b8-59827082222c', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:13:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:13:21 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Wkvfecgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:13:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:13:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:13:21 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad2e9e-9018-477f-bce4-4b5657828709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:13:21 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d680d1be-2581-46f5-8b74-1d80a834c1d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677] added
Nov 21 15:13:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c36ae9-2df8-4308-983b-937fa7b418e7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c650f6a-ec4b-4960-abdb-3c6dc744b0de]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Wkvfecgu {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Wkvfecgu" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23f4b6a-91a1-4749-bdd8-ae125241a578]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Wkvfecgu'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aa7db7-3d7b-4cd7-acc6-d7c0953d04b4]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[105b7948-6d49-47bd-bb77-07cbbcd918dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:13:21 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:13:21 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:13:21 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:13:21 user nova-compute[74882]: 
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fd9a1c-af65-46e6-883b-2912fb086a8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260]
Nov 21 15:13:21 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260] successful.
Nov 21 15:13:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b955ef-9162-459f-adfd-5ea474749a13]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5f81f3-d1e0-4b77-96e4-2e1f838fb5df]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:13:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:13:21 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d190e9f-a581-4aba-b87b-d3a195c20415]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Wkvfecgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:13:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23231646362323866', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231646362323866', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1961082268',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1961082268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1961082268',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPQsQLlzFgC4IyLTx79lLwEVcsds2id0bKLgF2DNW+VzzCfXJc2tu0zxZnQQ3n1vJ4nPAZgrTYCE/GhO5ptEWdQhiLAYa0gShWCItZnj8i6yRcAOvQyX1zkdBjOBsWhxQ==',key_name='tempest-keypair-481022832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-sp0gt2yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27e5950baa034e029e5db136635acd29',uuid=15e4f63e-87bc-4e34-8200-6290d2f2fbf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:42:b1,bridge_name='br-int',has_traffic_filtering=True,id=12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ec1046-0b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.objects.instance [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'pci_devices' on Instance uuid 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:13:22 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:13:22 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9111MB free_disk=25.05837631225586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:13:22 user nova-compute[74882]:   <uuid>15e4f63e-87bc-4e34-8200-6290d2f2fbf6</uuid>
Nov 21 15:13:22 user nova-compute[74882]:   <name>instance-00000030</name>
Nov 21 15:13:22 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:13:22 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:13:22 user nova-compute[74882]:   <metadata>
Nov 21 15:13:22 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:13:22 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:13:22 user nova-compute[74882]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1961082268</nova:name>
Nov 21 15:13:22 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:13:21</nova:creationTime>
Nov 21 15:13:22 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:13:22 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:13:22 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:13:22 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:13:22 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:13:22 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:13:22 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:13:22 user nova-compute[74882]:       <nova:owner>
Nov 21 15:13:22 user nova-compute[74882]:         <nova:user uuid="27e5950baa034e029e5db136635acd29">tempest-TestVolumeBootPattern-2100428844-project-member</nova:user>
Nov 21 15:13:22 user nova-compute[74882]:         <nova:project uuid="52b11227090b4d16929bdc1b9d2e8c16">tempest-TestVolumeBootPattern-2100428844</nova:project>
Nov 21 15:13:22 user nova-compute[74882]:       </nova:owner>
Nov 21 15:13:22 user nova-compute[74882]:       <nova:ports>
Nov 21 15:13:22 user nova-compute[74882]:         <nova:port uuid="12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5">
Nov 21 15:13:22 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 21 15:13:22 user nova-compute[74882]:         </nova:port>
Nov 21 15:13:22 user nova-compute[74882]:       </nova:ports>
Nov 21 15:13:22 user nova-compute[74882]:     </nova:instance>
Nov 21 15:13:22 user nova-compute[74882]:   </metadata>
Nov 21 15:13:22 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:13:22 user nova-compute[74882]:     <system>
Nov 21 15:13:22 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:13:22 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:13:22 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:13:22 user nova-compute[74882]:       <entry name="serial">15e4f63e-87bc-4e34-8200-6290d2f2fbf6</entry>
Nov 21 15:13:22 user nova-compute[74882]:       <entry name="uuid">15e4f63e-87bc-4e34-8200-6290d2f2fbf6</entry>
Nov 21 15:13:22 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:13:22 user nova-compute[74882]:     </system>
Nov 21 15:13:22 user nova-compute[74882]:   </sysinfo>
Nov 21 15:13:22 user nova-compute[74882]:   <os>
Nov 21 15:13:22 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:13:22 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:13:22 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:13:22 user nova-compute[74882]:   </os>
Nov 21 15:13:22 user nova-compute[74882]:   <features>
Nov 21 15:13:22 user nova-compute[74882]:     <acpi/>
Nov 21 15:13:22 user nova-compute[74882]:     <apic/>
Nov 21 15:13:22 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:13:22 user nova-compute[74882]:   </features>
Nov 21 15:13:22 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:13:22 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:13:22 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:13:22 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:13:22 user nova-compute[74882]:   </clock>
Nov 21 15:13:22 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:13:22 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:13:22 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:13:22 user nova-compute[74882]:   </cpu>
Nov 21 15:13:22 user nova-compute[74882]:   <devices>
Nov 21 15:13:22 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:13:22 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:13:22 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 15:13:22 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:13:22 user nova-compute[74882]:       <serial>80a6a968-8bac-42a1-ab9f-f143b76c8677</serial>
Nov 21 15:13:22 user nova-compute[74882]:     </disk>
Nov 21 15:13:22 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:13:22 user nova-compute[74882]:       <mac address="fa:16:3e:4d:42:b1"/>
Nov 21 15:13:22 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:13:22 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:13:22 user nova-compute[74882]:       <target dev="tap12ec1046-0b"/>
Nov 21 15:13:22 user nova-compute[74882]:     </interface>
Nov 21 15:13:22 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:13:22 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/15e4f63e-87bc-4e34-8200-6290d2f2fbf6/console.log" append="off"/>
Nov 21 15:13:22 user nova-compute[74882]:     </serial>
Nov 21 15:13:22 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:13:22 user nova-compute[74882]:     <video>
Nov 21 15:13:22 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:13:22 user nova-compute[74882]:     </video>
Nov 21 15:13:22 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:13:22 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:13:22 user nova-compute[74882]:     </rng>
Nov 21 15:13:22 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:13:22 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:13:22 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:13:22 user nova-compute[74882]:     </memballoon>
Nov 21 15:13:22 user nova-compute[74882]:   </devices>
Nov 21 15:13:22 user nova-compute[74882]: </domain>
Nov 21 15:13:22 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1961082268',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1961082268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1961082268',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPQsQLlzFgC4IyLTx79lLwEVcsds2id0bKLgF2DNW+VzzCfXJc2tu0zxZnQQ3n1vJ4nPAZgrTYCE/GhO5ptEWdQhiLAYa0gShWCItZnj8i6yRcAOvQyX1zkdBjOBsWhxQ==',key_name='tempest-keypair-481022832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-sp0gt2yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27e5950baa034e029e5db136635acd29',uuid=15e4f63e-87bc-4e34-8200-6290d2f2fbf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:42:b1,bridge_name='br-int',has_traffic_filtering=True,id=12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ec1046-0b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG os_vif [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:42:b1,bridge_name='br-int',has_traffic_filtering=True,id=12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ec1046-0b') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09e8d5c2-1eee-5fa9-b01a-603017c15262', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12ec1046-0b, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12ec1046-0b, col_values=(('qos', UUID('19600518-7107-4ed5-b3fe-3e0e454db01a')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12ec1046-0b, col_values=(('external_ids', {'iface-id': '12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:42:b1', 'vm-uuid': '15e4f63e-87bc-4e34-8200-6290d2f2fbf6'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:13:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:22 user nova-compute[74882]: INFO os_vif [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:42:b1,bridge_name='br-int',has_traffic_filtering=True,id=12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ec1046-0b')
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No VIF found with MAC fa:16:3e:4d:42:b1, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:13:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG nova.compute.manager [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] No waiting events found dispatching network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:13:24 user nova-compute[74882]: WARNING nova.compute.manager [req-b54ad45d-05e9-4157-8444-c78670a639de req-c1c246ea-401d-46f4-aa8f-f4bc951552d6 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received unexpected event network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance with vm_state building and task_state spawning.
Nov 21 15:13:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:13:26 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Instance spawned successfully.
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:13:26 user nova-compute[74882]: INFO nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:13:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] No waiting events found dispatching network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:13:26 user nova-compute[74882]: WARNING nova.compute.manager [req-b4f43665-b6ec-455a-bb16-52cdac9b4b62 req-41708dde-80bc-40b4-a31f-e8cf97dcbf26 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received unexpected event network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance with vm_state building and task_state spawning.
Nov 21 15:13:26 user nova-compute[74882]: INFO nova.compute.manager [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Took 11.40 seconds to build instance.
Nov 21 15:13:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-2328dcc5-bbf9-4a7d-9315-9df77781d675 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.559s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:13:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:13:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:13:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:14:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:14:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:14:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:15 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:18 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:18 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:18 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:14:19 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:14:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:14:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:14:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:14:19 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:14:19 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:14:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating instance_info_cache with network_info: [{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:14:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:14:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:14:22 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:14:22 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:14:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.057106018066406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:14:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:14:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:14:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:14:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:14:23 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:14:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:14:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:14:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:14:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 15:14:38 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 15:14:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:14:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:14:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:14:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:14:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:14:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:14:56 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:14:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 15:14:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:14:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:14:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:14:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:00 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:00 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 15:15:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:15:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-changed-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:15:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Refreshing instance network info cache due to event network-changed-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:15:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Acquiring lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:15:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Acquired lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:15:05 user nova-compute[74882]: DEBUG nova.network.neutron [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Refreshing network info cache for port 12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:15:06 user nova-compute[74882]: DEBUG nova.network.neutron [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updated VIF entry in instance network info cache for port 12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:15:06 user nova-compute[74882]: DEBUG nova.network.neutron [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating instance_info_cache with network_info: [{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:15:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0ba97c3a-2113-4356-8561-0f8f983fac3f req-d6929a86-81b6-4019-84d0-54dd4a1e55dc service nova] Releasing lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:15:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:15:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "3ecd145a-439f-4c61-a060-500b8404964c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "3ecd145a-439f-4c61-a060-500b8404964c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:15:11 user nova-compute[74882]: INFO nova.compute.claims [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Claim successful on node user
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:15:11 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:15:11 user nova-compute[74882]: INFO nova.virt.block_device [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Booting with volume snapshot 9326012d-515c-4f63-bb9b-3931fa09bdde at /dev/vda
Nov 21 15:15:11 user nova-compute[74882]: DEBUG nova.policy [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:15:12 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Successfully created port: da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Successfully updated port: da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquired lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-changed-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.compute.manager [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Refreshing instance network info cache due to event network-changed-da77078d-d23d-4b8e-a51f-5111a1c4d11c. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Acquiring lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Updating instance_info_cache with network_info: [{"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Releasing lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Instance network_info: |[{"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Acquired lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:15:13 user nova-compute[74882]: DEBUG nova.network.neutron [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Refreshing network info cache for port da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:15:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Updated VIF entry in instance network info cache for port da77078d-d23d-4b8e-a51f-5111a1c4d11c. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:15:14 user nova-compute[74882]: DEBUG nova.network.neutron [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Updating instance_info_cache with network_info: [{"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:15:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ed5fd825-b6ba-4c03-ad4f-8f2d680e7663 req-23e7d0f2-1bd2-44bf-b15c-c7d1c5ba2272 service nova] Releasing lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:15:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG os_brick.utils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[50232b04-da39-4a14-8392-dab9d0b6dca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538a0a9-5345-4cac-b4c4-0d80694cf198]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e57f50-1601-459f-bf97-7f2c5cbb13c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[13502843-1ef6-4c16-a968-bf472bf6cc04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:15:17 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:15:17 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8bba8e-7a13-4f66-95e7-3443403eb2c6]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG os_brick.utils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:15:17 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Updating existing volume attachment record: 142eb606-3c37-4871-a0bb-b222d777ca69 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:15:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Skipping network cache update for instance because it is Building. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:15:19 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:15:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating instance_info_cache with network_info: [{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:15:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:15:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:15:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:15:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:15:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:15:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:15:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:15:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:15:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.055816650390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3ecd145a-439f-4c61-a060-500b8404964c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:15:23 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Creating image(s)
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Ensure instance console log exists: /opt/stack/data/nova/instances/3ecd145a-439f-4c61-a060-500b8404964c/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Start _get_guest_xml network_info=[{"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-21T15:15:07Z,direct_url=<?>,disk_format='qcow2',id=8f4e9b88-f049-4a3a-b80b-48fdf439ec97,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1245556934',owner='52b11227090b4d16929bdc1b9d2e8c16',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-21T15:15:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liAghakG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ecd145a-439f-4c61-a060-500b8404964c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2b72c57-bd4d-4ebd-aa0f-52875ee98163', 'serial': 'c2b72c57-bd4d-4ebd-aa0f-52875ee98163'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '142eb606-3c37-4871-a0bb-b222d777ca69', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:15:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:15:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-21T15:15:07Z,direct_url=<?>,disk_format='qcow2',id=8f4e9b88-f049-4a3a-b80b-48fdf439ec97,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1245556934',owner='52b11227090b4d16929bdc1b9d2e8c16',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-21T15:15:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liAghakG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:15:23 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:15:23 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:15:23 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:15:23 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:15:23 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[020af318-ba95-422c-8e16-2299a0659225]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:15:23 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d96933-a20e-4822-a6f2-bb80da55e6d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163] added
Nov 21 15:15:23 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:23 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59c6806-1778-41c7-90a9-7b275119fca0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ac74e-64e2-44d0-be05-54e9773f9dcf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liAghakG {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liAghakG" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[be43afa1-61bb-4578-88c7-46fac3da41e3]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'liAghakG'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[de001b5d-eec3-4ba0-b356-b4aa3a2515af]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[56790625-34bb-43a8-abdc-f58496d636ba]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:15:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:15:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72bc7d5-e187-417d-b4d7-0bfaddb4125c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260]
Nov 21 15:15:24 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260] successful.
Nov 21 15:15:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc87f2-5bce-413a-967a-47cab59659ae]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d054cf4-7e6c-48a0-bdef-3b57429e1898]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:15:24 user nova-compute[74882]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 (non-flash)
Nov 21 15:15:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:15:24 user nova-compute[74882]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 (non-flash)
Nov 21 15:15:24 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b76a8a2-5854-460a-b8fe-32b57d835898]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:15:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liAghakG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23732313563343661', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732313563343661', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-711076728',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-711076728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-711076728',id=49,image_ref='8f4e9b88-f049-4a3a-b80b-48fdf439ec97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDi/jctDH6D7WcdwWCM3fNQJ6wplSIEQwo0qoiIz7OjM+lWtcj/1TTYy3q0ng+i5eF0YGzLnGsFOFgFVcg7kiIabyo7iJbH4788bSJQtGvadi8l2Wy4XhVmDeH+tB4PKQ==',key_name='tempest-keypair-2140641823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-53r50rwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2100428844',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:15:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27e5950baa034e029e5db136635acd29',uuid=3ecd145a-439f-4c61-a060-500b8404964c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5d:9c,bridge_name='br-int',has_traffic_filtering=True,id=da77078d-d23d-4b8e-a51f-5111a1c4d11c,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda77078d-d2') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.objects.instance [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ecd145a-439f-4c61-a060-500b8404964c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:15:25 user nova-compute[74882]:   <uuid>3ecd145a-439f-4c61-a060-500b8404964c</uuid>
Nov 21 15:15:25 user nova-compute[74882]:   <name>instance-00000031</name>
Nov 21 15:15:25 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:15:25 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:15:25 user nova-compute[74882]:   <metadata>
Nov 21 15:15:25 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:15:25 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:15:25 user nova-compute[74882]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-711076728</nova:name>
Nov 21 15:15:25 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:15:23</nova:creationTime>
Nov 21 15:15:25 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:15:25 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:15:25 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:15:25 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:15:25 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:15:25 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:15:25 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:15:25 user nova-compute[74882]:       <nova:owner>
Nov 21 15:15:25 user nova-compute[74882]:         <nova:user uuid="27e5950baa034e029e5db136635acd29">tempest-TestVolumeBootPattern-2100428844-project-member</nova:user>
Nov 21 15:15:25 user nova-compute[74882]:         <nova:project uuid="52b11227090b4d16929bdc1b9d2e8c16">tempest-TestVolumeBootPattern-2100428844</nova:project>
Nov 21 15:15:25 user nova-compute[74882]:       </nova:owner>
Nov 21 15:15:25 user nova-compute[74882]:       <nova:root type="image" uuid="8f4e9b88-f049-4a3a-b80b-48fdf439ec97"/>
Nov 21 15:15:25 user nova-compute[74882]:       <nova:ports>
Nov 21 15:15:25 user nova-compute[74882]:         <nova:port uuid="da77078d-d23d-4b8e-a51f-5111a1c4d11c">
Nov 21 15:15:25 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 15:15:25 user nova-compute[74882]:         </nova:port>
Nov 21 15:15:25 user nova-compute[74882]:       </nova:ports>
Nov 21 15:15:25 user nova-compute[74882]:     </nova:instance>
Nov 21 15:15:25 user nova-compute[74882]:   </metadata>
Nov 21 15:15:25 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:15:25 user nova-compute[74882]:     <system>
Nov 21 15:15:25 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:15:25 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:15:25 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:15:25 user nova-compute[74882]:       <entry name="serial">3ecd145a-439f-4c61-a060-500b8404964c</entry>
Nov 21 15:15:25 user nova-compute[74882]:       <entry name="uuid">3ecd145a-439f-4c61-a060-500b8404964c</entry>
Nov 21 15:15:25 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:15:25 user nova-compute[74882]:     </system>
Nov 21 15:15:25 user nova-compute[74882]:   </sysinfo>
Nov 21 15:15:25 user nova-compute[74882]:   <os>
Nov 21 15:15:25 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:15:25 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:15:25 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:15:25 user nova-compute[74882]:   </os>
Nov 21 15:15:25 user nova-compute[74882]:   <features>
Nov 21 15:15:25 user nova-compute[74882]:     <acpi/>
Nov 21 15:15:25 user nova-compute[74882]:     <apic/>
Nov 21 15:15:25 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:15:25 user nova-compute[74882]:   </features>
Nov 21 15:15:25 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:15:25 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:15:25 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:15:25 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:15:25 user nova-compute[74882]:   </clock>
Nov 21 15:15:25 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:15:25 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:15:25 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:15:25 user nova-compute[74882]:   </cpu>
Nov 21 15:15:25 user nova-compute[74882]:   <devices>
Nov 21 15:15:25 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:15:25 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:15:25 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 15:15:25 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:15:25 user nova-compute[74882]:       <serial>c2b72c57-bd4d-4ebd-aa0f-52875ee98163</serial>
Nov 21 15:15:25 user nova-compute[74882]:     </disk>
Nov 21 15:15:25 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:15:25 user nova-compute[74882]:       <mac address="fa:16:3e:bb:5d:9c"/>
Nov 21 15:15:25 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:15:25 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:15:25 user nova-compute[74882]:       <target dev="tapda77078d-d2"/>
Nov 21 15:15:25 user nova-compute[74882]:     </interface>
Nov 21 15:15:25 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:15:25 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/3ecd145a-439f-4c61-a060-500b8404964c/console.log" append="off"/>
Nov 21 15:15:25 user nova-compute[74882]:     </serial>
Nov 21 15:15:25 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:15:25 user nova-compute[74882]:     <video>
Nov 21 15:15:25 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:15:25 user nova-compute[74882]:     </video>
Nov 21 15:15:25 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:15:25 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:15:25 user nova-compute[74882]:     </rng>
Nov 21 15:15:25 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:15:25 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:15:25 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:15:25 user nova-compute[74882]:     </memballoon>
Nov 21 15:15:25 user nova-compute[74882]:   </devices>
Nov 21 15:15:25 user nova-compute[74882]: </domain>
Nov 21 15:15:25 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-711076728',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-711076728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-711076728',id=49,image_ref='8f4e9b88-f049-4a3a-b80b-48fdf439ec97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDi/jctDH6D7WcdwWCM3fNQJ6wplSIEQwo0qoiIz7OjM+lWtcj/1TTYy3q0ng+i5eF0YGzLnGsFOFgFVcg7kiIabyo7iJbH4788bSJQtGvadi8l2Wy4XhVmDeH+tB4PKQ==',key_name='tempest-keypair-2140641823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-53r50rwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2100428844',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:15:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27e5950baa034e029e5db136635acd29',uuid=3ecd145a-439f-4c61-a060-500b8404964c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5d:9c,bridge_name='br-int',has_traffic_filtering=True,id=da77078d-d23d-4b8e-a51f-5111a1c4d11c,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda77078d-d2') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG os_vif [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5d:9c,bridge_name='br-int',has_traffic_filtering=True,id=da77078d-d23d-4b8e-a51f-5111a1c4d11c,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda77078d-d2') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fb3dba6-251c-57de-9954-4899207f5966', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda77078d-d2, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda77078d-d2, col_values=(('qos', UUID('75dd6bf0-96e7-4963-a4bb-c4a63f6aad61')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda77078d-d2, col_values=(('external_ids', {'iface-id': 'da77078d-d23d-4b8e-a51f-5111a1c4d11c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:5d:9c', 'vm-uuid': '3ecd145a-439f-4c61-a060-500b8404964c'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:25 user nova-compute[74882]: INFO os_vif [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:5d:9c,bridge_name='br-int',has_traffic_filtering=True,id=da77078d-d23d-4b8e-a51f-5111a1c4d11c,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda77078d-d2')
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:15:25 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No VIF found with MAC fa:16:3e:bb:5d:9c, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Acquiring lock "3ecd145a-439f-4c61-a060-500b8404964c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:15:26 user nova-compute[74882]: DEBUG nova.compute.manager [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] No waiting events found dispatching network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:15:26 user nova-compute[74882]: WARNING nova.compute.manager [req-0c19d946-f62a-4e78-83be-7708d366384e req-2a7cf79e-169a-450f-983a-01967a9d1bfa service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received unexpected event network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance with vm_state building and task_state spawning.
Nov 21 15:15:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:15:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Instance spawned successfully.
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:15:28 user nova-compute[74882]: INFO nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:15:28 user nova-compute[74882]: INFO nova.compute.manager [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Took 17.36 seconds to build instance.
Nov 21 15:15:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-6065f253-964f-4cd9-aafb-e9b4cd1898af tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "3ecd145a-439f-4c61-a060-500b8404964c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.480s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Acquiring lock "3ecd145a-439f-4c61-a060-500b8404964c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:15:28 user nova-compute[74882]: DEBUG nova.compute.manager [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] No waiting events found dispatching network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:15:28 user nova-compute[74882]: WARNING nova.compute.manager [req-ea7b49af-0fcb-4e80-87d5-d291f7dbd0fb req-54286751-c858-4230-a15e-e7f242bc0334 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received unexpected event network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance with vm_state active and task_state None.
Nov 21 15:15:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:15:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:15:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:16:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:16:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:16:20 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:16:21 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating instance_info_cache with network_info: [{"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:16:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-15e4f63e-87bc-4e34-8200-6290d2f2fbf6" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:16:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:16:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:16:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:16:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:16:22 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:16:22 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:16:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:16:22 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:16:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:16:23 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.054458618164062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 3ecd145a-439f-4c61-a060-500b8404964c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:16:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:16:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:16:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:16:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:16:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:16:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:16:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:16:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:16:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-changed-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG nova.compute.manager [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Refreshing instance network info cache due to event network-changed-da77078d-d23d-4b8e-a51f-5111a1c4d11c. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Acquiring lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Acquired lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG nova.network.neutron [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Refreshing network info cache for port da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG nova.network.neutron [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Updated VIF entry in instance network info cache for port da77078d-d23d-4b8e-a51f-5111a1c4d11c. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG nova.network.neutron [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Updating instance_info_cache with network_info: [{"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-db499eb2-b0ee-4cfa-b6b9-5d59a8c56cf0 req-44861b0a-62f3-4572-b836-04ab3b0a430e service nova] Releasing lock "refresh_cache-3ecd145a-439f-4c61-a060-500b8404964c" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "3ecd145a-439f-4c61-a060-500b8404964c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "3ecd145a-439f-4c61-a060-500b8404964c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "3ecd145a-439f-4c61-a060-500b8404964c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:02 user nova-compute[74882]: INFO nova.compute.manager [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Terminating instance
Nov 21 15:17:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-vif-unplugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Acquiring lock "3ecd145a-439f-4c61-a060-500b8404964c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] No waiting events found dispatching network-vif-unplugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.compute.manager [req-74f80de4-5c50-4c3d-a436-ed73d5a8c387 req-0aac6907-1051-4dcb-bcff-b9e83ab88702 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-vif-unplugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Instance destroyed successfully.
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.objects.instance [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'resources' on Instance uuid 3ecd145a-439f-4c61-a060-500b8404964c {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:15:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-711076728',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-711076728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-711076728',id=49,image_ref='8f4e9b88-f049-4a3a-b80b-48fdf439ec97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDi/jctDH6D7WcdwWCM3fNQJ6wplSIEQwo0qoiIz7OjM+lWtcj/1TTYy3q0ng+i5eF0YGzLnGsFOFgFVcg7kiIabyo7iJbH4788bSJQtGvadi8l2Wy4XhVmDeH+tB4PKQ==',key_name='tempest-keypair-2140641823',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:15:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-53r50rwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2100428844',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:15:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27e5950baa034e029e5db136635acd29',uuid=3ecd145a-439f-4c61-a060-500b8404964c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "address": "fa:16:3e:bb:5d:9c", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda77078d-d2", "ovs_interfaceid": "da77078d-d23d-4b8e-a51f-5111a1c4d11c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5d:9c,bridge_name='br-int',has_traffic_filtering=True,id=da77078d-d23d-4b8e-a51f-5111a1c4d11c,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda77078d-d2') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_vif [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5d:9c,bridge_name='br-int',has_traffic_filtering=True,id=da77078d-d23d-4b8e-a51f-5111a1c4d11c,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda77078d-d2') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda77078d-d2, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75dd6bf0-96e7-4963-a4bb-c4a63f6aad61) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:03 user nova-compute[74882]: INFO os_vif [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:5d:9c,bridge_name='br-int',has_traffic_filtering=True,id=da77078d-d23d-4b8e-a51f-5111a1c4d11c,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda77078d-d2')
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liAghakG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:17:03 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[16635aa4-855c-4bb2-8ae3-695040956d49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:17:03 user nova-compute[74882]: No targets found.
Nov 21 15:17:03 user nova-compute[74882]: iSNS:
Nov 21 15:17:03 user nova-compute[74882]: No targets found.
Nov 21 15:17:03 user nova-compute[74882]: STATIC:
Nov 21 15:17:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163
Nov 21 15:17:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:17:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:17:03 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677
Nov 21 15:17:03 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:17:03 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:17:03 user nova-compute[74882]: FIRMWARE:
Nov 21 15:17:03 user nova-compute[74882]: No targets found.
Nov 21 15:17:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:17:03 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:17:03 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad999aa-0e10-4ec4-a370-c6f614d6e570]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f003d7-75c6-49d2-b043-4013416cbbb6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:17:03 user nova-compute[74882]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 (non-flash)
Nov 21 15:17:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:17:03 user nova-compute[74882]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 (non-flash)
Nov 21 15:17:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c5d8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e60bcc7-004f-4187-b1c4-924afba8ac0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa19538-c9ac-42bd-b4f8-01431d365122]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[25667d16-893d-46ba-a735-8f4d9a99601a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d3b010-6deb-4261-bed8-4f9e4d6a3b98]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_147c08a5', '/dev/disk/by-id/scsi-1SCST_BIO147c08a5-7215c46aa1a2b47e', '/dev/disk/by-id/scsi-23732313563343661') {{(pid=85964) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ba4287-66c8-49b8-bc6d-3313ea25968c]: (4, None) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[693c3031-40c6-4b7c-bcdb-0dafbb0dce3a]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1955daf-0ac6-4761-9602-41360b6da0f1]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260]
Nov 21 15:17:03 user nova-compute[74882]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163, portal: 172.16.0.220,3260] successful.
Nov 21 15:17:03 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2b72c57-bd4d-4ebd-aa0f-52875ee98163 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83623ab-7c3d-46ac-a350-a168bb4010ae]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== disconnect_volume: return (303ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:17:03 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:17:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Deleting instance files /opt/stack/data/nova/instances/3ecd145a-439f-4c61-a060-500b8404964c_del
Nov 21 15:17:03 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Deletion of /opt/stack/data/nova/instances/3ecd145a-439f-4c61-a060-500b8404964c_del complete
Nov 21 15:17:04 user nova-compute[74882]: INFO nova.compute.manager [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 21 15:17:04 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:17:04 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:17:04 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:17:04 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:17:04 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Took 0.84 seconds to deallocate network for instance.
Nov 21 15:17:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-0e615a9e-ccc4-4fe0-8d8c-e0985d7ca45e req-5c259218-7fc0-4a89-8e20-8855641a7000 service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-vif-deleted-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received event network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Acquiring lock "3ecd145a-439f-4c61-a060-500b8404964c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] Lock "3ecd145a-439f-4c61-a060-500b8404964c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG nova.compute.manager [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] No waiting events found dispatching network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:17:05 user nova-compute[74882]: WARNING nova.compute.manager [req-fb69d02f-3b9b-4dc9-b949-35cd61fa32d3 req-8c209ca7-45ef-4a44-8d95-ca8b6534a47c service nova] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Received unexpected event network-vif-plugged-da77078d-d23d-4b8e-a51f-5111a1c4d11c for instance with vm_state active and task_state deleting.
Nov 21 15:17:05 user nova-compute[74882]: INFO nova.compute.manager [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Took 0.73 seconds to detach 1 volumes for instance.
Nov 21 15:17:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 3ecd145a-439f-4c61-a060-500b8404964c] Deleting volume: c2b72c57-bd4d-4ebd-aa0f-52875ee98163 {{(pid=74882) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:17:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:05 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Deleted allocations for instance 3ecd145a-439f-4c61-a060-500b8404964c
Nov 21 15:17:06 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-8925c4b9-6455-431b-8c6e-e57c2c8e30f7 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "3ecd145a-439f-4c61-a060-500b8404964c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.137s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:17:21 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:17:21 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:17:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:24 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:17:24 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:17:25 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:17:25 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:17:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.053569793701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:17:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:17:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:17:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:56 user nova-compute[74882]: INFO nova.compute.manager [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Terminating instance
Nov 21 15:17:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-vif-unplugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] No waiting events found dispatching network-vif-unplugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:17:56 user nova-compute[74882]: DEBUG nova.compute.manager [req-a9be661a-92ca-4289-ba3b-5424facc9cd3 req-9edda641-2830-48e6-9ef5-e4b2d41baa80 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-vif-unplugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:17:57 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Instance destroyed successfully.
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.objects.instance [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'resources' on Instance uuid 15e4f63e-87bc-4e34-8200-6290d2f2fbf6 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1961082268',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1961082268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1961082268',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPQsQLlzFgC4IyLTx79lLwEVcsds2id0bKLgF2DNW+VzzCfXJc2tu0zxZnQQ3n1vJ4nPAZgrTYCE/GhO5ptEWdQhiLAYa0gShWCItZnj8i6yRcAOvQyX1zkdBjOBsWhxQ==',key_name='tempest-keypair-481022832',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:13:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-sp0gt2yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:13:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27e5950baa034e029e5db136635acd29',uuid=15e4f63e-87bc-4e34-8200-6290d2f2fbf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "address": "fa:16:3e:4d:42:b1", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ec1046-0b", "ovs_interfaceid": "12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:42:b1,bridge_name='br-int',has_traffic_filtering=True,id=12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ec1046-0b') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_vif [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:42:b1,bridge_name='br-int',has_traffic_filtering=True,id=12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ec1046-0b') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12ec1046-0b, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19600518-7107-4ed5-b3fe-3e0e454db01a) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:17:57 user nova-compute[74882]: INFO os_vif [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:42:b1,bridge_name='br-int',has_traffic_filtering=True,id=12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ec1046-0b')
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Wkvfecgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:17:57 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e626ef05-5c5a-4c69-b640-ec713e79724a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:17:57 user nova-compute[74882]: No targets found.
Nov 21 15:17:57 user nova-compute[74882]: iSNS:
Nov 21 15:17:57 user nova-compute[74882]: No targets found.
Nov 21 15:17:57 user nova-compute[74882]: STATIC:
Nov 21 15:17:57 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677
Nov 21 15:17:57 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:17:57 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:17:57 user nova-compute[74882]: FIRMWARE:
Nov 21 15:17:57 user nova-compute[74882]: No targets found.
Nov 21 15:17:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:17:57 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:17:57 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe26eed6-2980-482d-a934-927bb5ac1143]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[206251e4-dcea-475b-9f5a-04e722f8ed14]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:17:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 (non-flash)
Nov 21 15:17:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c5a01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[558affd9-c4c7-48e6-93fc-b4ed2ba64c2b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46053ab-5410-4388-a1ac-f1a078442198]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec00b8b9-45fb-4fc7-9bb7-3bf3b87ba928]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdb87cb-5650-4c88-a26a-4453cd7dc7ae]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23231646362323866', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5c14ccee', '/dev/disk/by-id/scsi-1SCST_BIO5c14ccee-21dcb28f1f3abc49') {{(pid=85964) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9c7e9-5eab-4505-a923-43ee9fa7c789]: (4, None) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b61525-36f0-4ca7-a8a5-009a0684610d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de1b7a8-0bf2-4eb6-a8f9-bf3b36bc49e6]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260]
Nov 21 15:17:57 user nova-compute[74882]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677, portal: 172.16.0.220,3260] successful.
Nov 21 15:17:57 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a6a968-8bac-42a1-ab9f-f143b76c8677 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01c20e5-f0be-4c10-9323-7052e2e1f987]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== disconnect_volume: return (314ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:17:57 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Deleting instance files /opt/stack/data/nova/instances/15e4f63e-87bc-4e34-8200-6290d2f2fbf6_del
Nov 21 15:17:57 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Deletion of /opt/stack/data/nova/instances/15e4f63e-87bc-4e34-8200-6290d2f2fbf6_del complete
Nov 21 15:17:57 user nova-compute[74882]: INFO nova.compute.manager [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 21 15:17:57 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:17:57 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:17:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:17:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Acquiring lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:17:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:17:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:17:59 user nova-compute[74882]: DEBUG nova.compute.manager [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] No waiting events found dispatching network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:17:59 user nova-compute[74882]: WARNING nova.compute.manager [req-e822ca18-0054-4940-b62d-84b24c87cfa5 req-06efc847-498e-4908-926c-a260c50f51b7 service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received unexpected event network-vif-plugged-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 for instance with vm_state active and task_state deleting.
Nov 21 15:17:59 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:17:59 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Took 1.34 seconds to deallocate network for instance.
Nov 21 15:17:59 user nova-compute[74882]: INFO nova.compute.manager [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Took 0.73 seconds to detach 1 volumes for instance.
Nov 21 15:17:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Deleting volume: 80a6a968-8bac-42a1-ab9f-f143b76c8677 {{(pid=74882) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 21 15:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:18:00 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:18:00 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:18:00 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Deleted allocations for instance 15e4f63e-87bc-4e34-8200-6290d2f2fbf6
Nov 21 15:18:00 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-647521aa-1ca4-494f-9627-e99b5c7a4b66 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "15e4f63e-87bc-4e34-8200-6290d2f2fbf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.622s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:18:01 user nova-compute[74882]: DEBUG nova.compute.manager [req-43980798-4249-4300-a0fa-6babf460c417 req-70b22c24-0d0c-4f89-91d2-e44eacc4b01e service nova] [instance: 15e4f63e-87bc-4e34-8200-6290d2f2fbf6] Received event network-vif-deleted-12ec1046-0b41-4d1a-ba21-a2cc7ea3d3b5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:18:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:17 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:18:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:18:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:18:22 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:18:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:18:25 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:18:25 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:18:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=25.052722930908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:18:25 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:18:26 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:18:26 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:18:26 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:18:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:18:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:18:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:18:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:18:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:18:56 user nova-compute[74882]: INFO nova.compute.claims [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Claim successful on node user
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.network.neutron [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:18:56 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:18:56 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG nova.policy [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:18:57 user nova-compute[74882]: INFO nova.virt.block_device [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Booting with volume 13e58418-c558-4685-a396-2867666c5e76 at /dev/vda
Nov 21 15:18:57 user nova-compute[74882]: DEBUG os_brick.utils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[592a38a1-f2a7-4e3c-8393-26dcf61905d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a96d2-a196-4855-aee5-35d98e48579d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fad633b-2143-4c35-bc5b-d0f45b4347fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7208e407-9952-4904-b51e-69be1c1d78b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:18:57 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:18:57 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[214c4196-9f86-468d-9557-298733bd457b]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG os_brick.utils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updating existing volume attachment record: 0161afdc-c6c0-4902-ab83-c267521cc509 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:18:57 user nova-compute[74882]: DEBUG nova.network.neutron [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Successfully created port: 3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Successfully updated port: 3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquired lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-changed-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG nova.compute.manager [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Refreshing instance network info cache due to event network-changed-3db6ecac-fd5e-44a9-9064-82ad60714880. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Acquiring lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:18:58 user nova-compute[74882]: DEBUG nova.network.neutron [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updating instance_info_cache with network_info: [{"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Releasing lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:18:59 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Instance network_info: |[{"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Acquired lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:18:59 user nova-compute[74882]: DEBUG nova.network.neutron [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Refreshing network info cache for port 3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:18:59 user nova-compute[74882]: DEBUG nova.network.neutron [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updated VIF entry in instance network info cache for port 3db6ecac-fd5e-44a9-9064-82ad60714880. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:18:59 user nova-compute[74882]: DEBUG nova.network.neutron [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updating instance_info_cache with network_info: [{"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:18:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-627d03dc-4da3-4725-9bce-34aa561a3619 req-1fbe834d-e039-4ca6-8863-330fc6faeaf4 service nova] Releasing lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:19:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:19:05 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Creating image(s)
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Ensure instance console log exists: /opt/stack/data/nova/instances/1a7daa09-d3b6-4c97-96ac-fcca6f29d762/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Start _get_guest_xml network_info=[{"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a7daa09-d3b6-4c97-96ac-fcca6f29d762', 'attached_at': '', 'detached_at': '', 'volume_id': '13e58418-c558-4685-a396-2867666c5e76', 'serial': '13e58418-c558-4685-a396-2867666c5e76'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '0161afdc-c6c0-4902-ab83-c267521cc509', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:19:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:19:05 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:19:05 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:19:05 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:19:05 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b41389-1ad9-4a3e-a7cc-2ccb10aa8377]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:19:05 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd657e0a-2c8e-47e5-8df7-39b385d7ab5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76] added
Nov 21 15:19:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ba000a-3ea7-4b81-bcad-f226ef6caa03]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26314cd-0a2e-4e92-8c98-9bad28c9b2ee]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAtqoxak {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAtqoxak" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d08a4c-1dac-46d4-8f37-26ae0c30d112]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAtqoxak'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76873d-2d73-4d35-a2f6-abcafaef6ad1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e7290d-c957-4dfa-8394-bb5894ebc95c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:19:05 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:19:05 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:19:05 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:19:05 user nova-compute[74882]: 
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4a771-d5d9-4530-8018-c459b3c9aa7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]
Nov 21 15:19:05 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.
Nov 21 15:19:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b71a0-94be-44b3-8837-0095304ae9fa]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75d3126-1d2a-4389-958b-f45690c27e7a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:19:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:19:05 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fbb5bc-15be-4b87-bf8d-b7f67012dfb1]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:19:05 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23630306164393431', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630306164393431', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1798000725',display_name='tempest-TestVolumeBootPattern-server-1798000725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1798000725',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-l8koipk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:18:57Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=1a7daa09-d3b6-4c97-96ac-fcca6f29d762,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:da:ac,bridge_name='br-int',has_traffic_filtering=True,id=3db6ecac-fd5e-44a9-9064-82ad60714880,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db6ecac-fd') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.objects.instance [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:19:06 user nova-compute[74882]:   <uuid>1a7daa09-d3b6-4c97-96ac-fcca6f29d762</uuid>
Nov 21 15:19:06 user nova-compute[74882]:   <name>instance-00000032</name>
Nov 21 15:19:06 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:19:06 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:19:06 user nova-compute[74882]:   <metadata>
Nov 21 15:19:06 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:19:06 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:19:06 user nova-compute[74882]:       <nova:name>tempest-TestVolumeBootPattern-server-1798000725</nova:name>
Nov 21 15:19:06 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:19:05</nova:creationTime>
Nov 21 15:19:06 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:19:06 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:19:06 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:19:06 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:19:06 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:19:06 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:19:06 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:19:06 user nova-compute[74882]:       <nova:owner>
Nov 21 15:19:06 user nova-compute[74882]:         <nova:user uuid="27e5950baa034e029e5db136635acd29">tempest-TestVolumeBootPattern-2100428844-project-member</nova:user>
Nov 21 15:19:06 user nova-compute[74882]:         <nova:project uuid="52b11227090b4d16929bdc1b9d2e8c16">tempest-TestVolumeBootPattern-2100428844</nova:project>
Nov 21 15:19:06 user nova-compute[74882]:       </nova:owner>
Nov 21 15:19:06 user nova-compute[74882]:       <nova:ports>
Nov 21 15:19:06 user nova-compute[74882]:         <nova:port uuid="3db6ecac-fd5e-44a9-9064-82ad60714880">
Nov 21 15:19:06 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 21 15:19:06 user nova-compute[74882]:         </nova:port>
Nov 21 15:19:06 user nova-compute[74882]:       </nova:ports>
Nov 21 15:19:06 user nova-compute[74882]:     </nova:instance>
Nov 21 15:19:06 user nova-compute[74882]:   </metadata>
Nov 21 15:19:06 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:19:06 user nova-compute[74882]:     <system>
Nov 21 15:19:06 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:19:06 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:19:06 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:19:06 user nova-compute[74882]:       <entry name="serial">1a7daa09-d3b6-4c97-96ac-fcca6f29d762</entry>
Nov 21 15:19:06 user nova-compute[74882]:       <entry name="uuid">1a7daa09-d3b6-4c97-96ac-fcca6f29d762</entry>
Nov 21 15:19:06 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:19:06 user nova-compute[74882]:     </system>
Nov 21 15:19:06 user nova-compute[74882]:   </sysinfo>
Nov 21 15:19:06 user nova-compute[74882]:   <os>
Nov 21 15:19:06 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:19:06 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:19:06 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:19:06 user nova-compute[74882]:   </os>
Nov 21 15:19:06 user nova-compute[74882]:   <features>
Nov 21 15:19:06 user nova-compute[74882]:     <acpi/>
Nov 21 15:19:06 user nova-compute[74882]:     <apic/>
Nov 21 15:19:06 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:19:06 user nova-compute[74882]:   </features>
Nov 21 15:19:06 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:19:06 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:19:06 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:19:06 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:19:06 user nova-compute[74882]:   </clock>
Nov 21 15:19:06 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:19:06 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:19:06 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:19:06 user nova-compute[74882]:   </cpu>
Nov 21 15:19:06 user nova-compute[74882]:   <devices>
Nov 21 15:19:06 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:19:06 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:19:06 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 15:19:06 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:19:06 user nova-compute[74882]:       <serial>13e58418-c558-4685-a396-2867666c5e76</serial>
Nov 21 15:19:06 user nova-compute[74882]:     </disk>
Nov 21 15:19:06 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:19:06 user nova-compute[74882]:       <mac address="fa:16:3e:80:da:ac"/>
Nov 21 15:19:06 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:19:06 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:19:06 user nova-compute[74882]:       <target dev="tap3db6ecac-fd"/>
Nov 21 15:19:06 user nova-compute[74882]:     </interface>
Nov 21 15:19:06 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:19:06 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/1a7daa09-d3b6-4c97-96ac-fcca6f29d762/console.log" append="off"/>
Nov 21 15:19:06 user nova-compute[74882]:     </serial>
Nov 21 15:19:06 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:19:06 user nova-compute[74882]:     <video>
Nov 21 15:19:06 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:19:06 user nova-compute[74882]:     </video>
Nov 21 15:19:06 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:19:06 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:19:06 user nova-compute[74882]:     </rng>
Nov 21 15:19:06 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:19:06 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:19:06 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:19:06 user nova-compute[74882]:     </memballoon>
Nov 21 15:19:06 user nova-compute[74882]:   </devices>
Nov 21 15:19:06 user nova-compute[74882]: </domain>
Nov 21 15:19:06 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1798000725',display_name='tempest-TestVolumeBootPattern-server-1798000725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1798000725',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-l8koipk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:18:57Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=1a7daa09-d3b6-4c97-96ac-fcca6f29d762,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:da:ac,bridge_name='br-int',has_traffic_filtering=True,id=3db6ecac-fd5e-44a9-9064-82ad60714880,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db6ecac-fd') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG os_vif [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:da:ac,bridge_name='br-int',has_traffic_filtering=True,id=3db6ecac-fd5e-44a9-9064-82ad60714880,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db6ecac-fd') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ab4d81f-3d65-5257-a6b1-c87806c48cbb', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3db6ecac-fd, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3db6ecac-fd, col_values=(('qos', UUID('36dbcb0d-920a-4824-a254-066fa71cd59d')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3db6ecac-fd, col_values=(('external_ids', {'iface-id': '3db6ecac-fd5e-44a9-9064-82ad60714880', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:da:ac', 'vm-uuid': '1a7daa09-d3b6-4c97-96ac-fcca6f29d762'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:06 user nova-compute[74882]: INFO os_vif [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:da:ac,bridge_name='br-int',has_traffic_filtering=True,id=3db6ecac-fd5e-44a9-9064-82ad60714880,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db6ecac-fd')
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:19:06 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No VIF found with MAC fa:16:3e:80:da:ac, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG nova.compute.manager [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:19:08 user nova-compute[74882]: WARNING nova.compute.manager [req-3b1c8484-99c1-4177-9de7-10577de1039f req-a0ef8177-78f0-4d1f-b125-d76ca6875a85 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received unexpected event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with vm_state building and task_state spawning.
Nov 21 15:19:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:19:10 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Instance spawned successfully.
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:19:10 user nova-compute[74882]: INFO nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:19:10 user nova-compute[74882]: DEBUG nova.compute.manager [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:19:10 user nova-compute[74882]: WARNING nova.compute.manager [req-e703599e-c662-4053-b4f3-112aeb6a4b45 req-797b833a-8766-4995-af24-40becb72fd75 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received unexpected event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with vm_state building and task_state spawning.
Nov 21 15:19:10 user nova-compute[74882]: INFO nova.compute.manager [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Took 13.71 seconds to build instance.
Nov 21 15:19:10 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-de5beb71-1134-40e0-bfc6-d5818ef7dbc2 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.803s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:19:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:18 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:19:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:19:23 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:19:23 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:19:23 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:19:23 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:19:24 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updating instance_info_cache with network_info: [{"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:19:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:19:24 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:19:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:19:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:19:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:19:27 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:19:27 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:19:27 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=25.05063247680664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:19:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:19:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:44 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:19:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 15:19:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 15:19:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:19:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:19:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:19:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:19:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:02 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:02 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 15:20:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:23 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:20:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:20:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:20:25 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:20:25 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updating instance_info_cache with network_info: [{"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:20:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:20:28 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:20:28 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.05001449584961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:20:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:20:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-changed-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Refreshing instance network info cache due to event network-changed-3db6ecac-fd5e-44a9-9064-82ad60714880. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:20:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Acquiring lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:20:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Acquired lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:20:48 user nova-compute[74882]: DEBUG nova.network.neutron [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Refreshing network info cache for port 3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG nova.network.neutron [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updated VIF entry in instance network info cache for port 3db6ecac-fd5e-44a9-9064-82ad60714880. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG nova.network.neutron [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updating instance_info_cache with network_info: [{"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7617ead0-e76a-4949-bc74-e0e04e2daa0a req-3615f39a-9027-498e-bbbf-36aca52e8710 service nova] Releasing lock "refresh_cache-1a7daa09-d3b6-4c97-96ac-fcca6f29d762" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:49 user nova-compute[74882]: INFO nova.compute.manager [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Terminating instance
Nov 21 15:20:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-unplugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-unplugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG nova.compute.manager [req-452c513d-892c-4456-aa3a-29a137fc049d req-313259ae-2708-4d42-919c-b431d1155720 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-unplugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Instance destroyed successfully.
Nov 21 15:20:49 user nova-compute[74882]: DEBUG nova.objects.instance [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'resources' on Instance uuid 1a7daa09-d3b6-4c97-96ac-fcca6f29d762 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1798000725',display_name='tempest-TestVolumeBootPattern-server-1798000725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1798000725',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-l8koipk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:19:10Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=1a7daa09-d3b6-4c97-96ac-fcca6f29d762,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "3db6ecac-fd5e-44a9-9064-82ad60714880", "address": "fa:16:3e:80:da:ac", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3db6ecac-fd", "ovs_interfaceid": "3db6ecac-fd5e-44a9-9064-82ad60714880", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:da:ac,bridge_name='br-int',has_traffic_filtering=True,id=3db6ecac-fd5e-44a9-9064-82ad60714880,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db6ecac-fd') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_vif [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:da:ac,bridge_name='br-int',has_traffic_filtering=True,id=3db6ecac-fd5e-44a9-9064-82ad60714880,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db6ecac-fd') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3db6ecac-fd, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36dbcb0d-920a-4824-a254-066fa71cd59d) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:20:50 user nova-compute[74882]: INFO os_vif [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:da:ac,bridge_name='br-int',has_traffic_filtering=True,id=3db6ecac-fd5e-44a9-9064-82ad60714880,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3db6ecac-fd')
Nov 21 15:20:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:20:50 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6178f064-4908-4a4b-bf8c-ea897c26bbe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:20:50 user nova-compute[74882]: No targets found.
Nov 21 15:20:50 user nova-compute[74882]: iSNS:
Nov 21 15:20:50 user nova-compute[74882]: No targets found.
Nov 21 15:20:50 user nova-compute[74882]: STATIC:
Nov 21 15:20:50 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76
Nov 21 15:20:50 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:20:50 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:20:50 user nova-compute[74882]: FIRMWARE:
Nov 21 15:20:50 user nova-compute[74882]: No targets found.
Nov 21 15:20:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:20:50 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:20:50 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8efb865-3e37-42fb-8562-e44fd0216370]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c93ae4-11f4-40f6-8d42-2f71da4dbe3b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:20:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:20:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6b3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc15e9-f07a-4248-b841-3e4672cfabe9]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e4161b-3214-434a-8dd2-1bbc823be3a4]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ad7eb-fea7-4acf-a207-65fccb8fc8e6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54b123-b3f1-4eb8-b7b0-66714b25cd9e]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b590a-1b4d-424d-af64-f7877f2b605b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[036c03b9-11c3-459c-ade8-0a779bf6eee5]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]
Nov 21 15:20:50 user nova-compute[74882]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.
Nov 21 15:20:50 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a11c521-69d0-4ccc-9a5b-ebc29e55f9c7]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== disconnect_volume: return (306ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:20:50 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Deleting instance files /opt/stack/data/nova/instances/1a7daa09-d3b6-4c97-96ac-fcca6f29d762_del
Nov 21 15:20:50 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Deletion of /opt/stack/data/nova/instances/1a7daa09-d3b6-4c97-96ac-fcca6f29d762_del complete
Nov 21 15:20:50 user nova-compute[74882]: INFO nova.compute.manager [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 21 15:20:50 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:20:51 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Took 0.89 seconds to deallocate network for instance.
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-b3187e29-9efb-4a15-a6b7-ee65b6911fc5 req-93c34103-c959-4f49-90e5-3c9a6b137c22 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-deleted-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:20:51 user nova-compute[74882]: WARNING nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received unexpected event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with vm_state active and task_state deleting.
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:20:51 user nova-compute[74882]: WARNING nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received unexpected event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with vm_state active and task_state deleting.
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:20:51 user nova-compute[74882]: WARNING nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received unexpected event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with vm_state active and task_state deleting.
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-unplugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-unplugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-unplugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Acquiring lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:51 user nova-compute[74882]: DEBUG nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] No waiting events found dispatching network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:20:51 user nova-compute[74882]: WARNING nova.compute.manager [req-d1597d5a-3324-47ba-a6cf-62a6cbed1fc0 req-f3052a29-bad5-4583-85a4-9eb18ae11512 service nova] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Received unexpected event network-vif-plugged-3db6ecac-fd5e-44a9-9064-82ad60714880 for instance with vm_state active and task_state deleting.
Nov 21 15:20:52 user nova-compute[74882]: INFO nova.compute.manager [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 1a7daa09-d3b6-4c97-96ac-fcca6f29d762] Took 0.77 seconds to detach 1 volumes for instance.
Nov 21 15:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:20:52 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:20:52 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:52 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Deleted allocations for instance 1a7daa09-d3b6-4c97-96ac-fcca6f29d762
Nov 21 15:20:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-44d162fb-6d9f-4ae9-a70e-fe85177b9fdf tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "1a7daa09-d3b6-4c97-96ac-fcca6f29d762" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.224s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:20:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:20:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:22 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:21:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:21:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:21:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:21:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:21:29 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:21:29 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9091MB free_disk=25.049072265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:21:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:21:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:21:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:21:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:30 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:21:30 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:21:30 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:21:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:21:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:21:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:21:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:21:41 user nova-compute[74882]: INFO nova.compute.claims [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Claim successful on node user
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:21:41 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:21:41 user nova-compute[74882]: INFO nova.virt.block_device [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Booting with volume 13e58418-c558-4685-a396-2867666c5e76 at /dev/vda
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.policy [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG os_brick.utils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[979b5bc5-4d9c-4695-9ca9-3b28613530cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362b649-e7ea-48d3-a94b-e3ba6a9118f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8df780-3813-4cdc-a5a7-15b87ca44d31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa77ac7-41b3-412f-b99b-313e600092fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:21:41 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:21:41 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5516ab04-528e-4bb5-b2cf-afebe2609a30]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG os_brick.utils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:21:41 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating existing volume attachment record: fbe609b5-183a-48d1-ac56-90f357032a44 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:21:42 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Successfully created port: da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Successfully updated port: da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-changed-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Refreshing instance network info cache due to event network-changed-da4ed636-a1fc-421c-9645-a79d438fdaf1. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.network.neutron [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Instance network_info: |[{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:21:43 user nova-compute[74882]: DEBUG nova.network.neutron [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Refreshing network info cache for port da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:21:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updated VIF entry in instance network info cache for port da4ed636-a1fc-421c-9645-a79d438fdaf1. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:21:44 user nova-compute[74882]: DEBUG nova.network.neutron [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:21:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-23ca358d-0e34-4ed1-80ab-90a0d46526e0 req-f63de724-82d3-412d-af23-92111ae10f0b service nova] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:21:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:21:47 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Creating image(s)
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Ensure instance console log exists: /opt/stack/data/nova/instances/2de0e971-a800-4d42-a52c-f3bdac3684db/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Start _get_guest_xml network_info=[{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2de0e971-a800-4d42-a52c-f3bdac3684db', 'attached_at': '', 'detached_at': '', 'volume_id': '13e58418-c558-4685-a396-2867666c5e76', 'serial': '13e58418-c558-4685-a396-2867666c5e76'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'fbe609b5-183a-48d1-ac56-90f357032a44', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:21:47 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:21:47 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:21:47 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:21:47 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:21:47 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bdc469-0be6-4203-80ec-66adec0af400]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:21:47 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e20cc7b-fe94-4a75-b219-e39adffaf9dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76] added
Nov 21 15:21:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a7d9c-5ef9-45a5-8aba-fd1594e143ff]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a151e0-0cdd-4ad7-b6c1-a71a136a0886]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAtqoxak {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAtqoxak" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e15400-e161-4066-a3dc-985d75f4e1d8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAtqoxak'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59c825-9ace-411b-af42-5fa4adf589c2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac07fd0d-c473-44b4-857c-455ba436ee86]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:21:47 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:21:47 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:21:47 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:21:47 user nova-compute[74882]: 
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cbca5c-c3c5-4198-ab96-60cd57db824a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]
Nov 21 15:21:47 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.
Nov 21 15:21:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f9bc29-b043-4fd8-a5f9-864dbe27752d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7f8364-c957-4ffa-a9ac-4522483bd7f0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:21:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:21:47 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c25d6-156c-4ce9-9af1-7c68c3e59a44]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:21:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23630306164393431', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630306164393431', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-702719148',display_name='tempest-TestVolumeBootPattern-server-702719148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-702719148',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-vz8tfe5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:21:42Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=2de0e971-a800-4d42-a52c-f3bdac3684db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:08:35,bridge_name='br-int',has_traffic_filtering=True,id=da4ed636-a1fc-421c-9645-a79d438fdaf1,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4ed636-a1') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.objects.instance [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'pci_devices' on Instance uuid 2de0e971-a800-4d42-a52c-f3bdac3684db {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:21:48 user nova-compute[74882]:   <uuid>2de0e971-a800-4d42-a52c-f3bdac3684db</uuid>
Nov 21 15:21:48 user nova-compute[74882]:   <name>instance-00000033</name>
Nov 21 15:21:48 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:21:48 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:21:48 user nova-compute[74882]:   <metadata>
Nov 21 15:21:48 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:21:48 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:21:48 user nova-compute[74882]:       <nova:name>tempest-TestVolumeBootPattern-server-702719148</nova:name>
Nov 21 15:21:48 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:21:47</nova:creationTime>
Nov 21 15:21:48 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:21:48 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:21:48 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:21:48 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:21:48 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:21:48 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:21:48 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:21:48 user nova-compute[74882]:       <nova:owner>
Nov 21 15:21:48 user nova-compute[74882]:         <nova:user uuid="27e5950baa034e029e5db136635acd29">tempest-TestVolumeBootPattern-2100428844-project-member</nova:user>
Nov 21 15:21:48 user nova-compute[74882]:         <nova:project uuid="52b11227090b4d16929bdc1b9d2e8c16">tempest-TestVolumeBootPattern-2100428844</nova:project>
Nov 21 15:21:48 user nova-compute[74882]:       </nova:owner>
Nov 21 15:21:48 user nova-compute[74882]:       <nova:ports>
Nov 21 15:21:48 user nova-compute[74882]:         <nova:port uuid="da4ed636-a1fc-421c-9645-a79d438fdaf1">
Nov 21 15:21:48 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 21 15:21:48 user nova-compute[74882]:         </nova:port>
Nov 21 15:21:48 user nova-compute[74882]:       </nova:ports>
Nov 21 15:21:48 user nova-compute[74882]:     </nova:instance>
Nov 21 15:21:48 user nova-compute[74882]:   </metadata>
Nov 21 15:21:48 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:21:48 user nova-compute[74882]:     <system>
Nov 21 15:21:48 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:21:48 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:21:48 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:21:48 user nova-compute[74882]:       <entry name="serial">2de0e971-a800-4d42-a52c-f3bdac3684db</entry>
Nov 21 15:21:48 user nova-compute[74882]:       <entry name="uuid">2de0e971-a800-4d42-a52c-f3bdac3684db</entry>
Nov 21 15:21:48 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:21:48 user nova-compute[74882]:     </system>
Nov 21 15:21:48 user nova-compute[74882]:   </sysinfo>
Nov 21 15:21:48 user nova-compute[74882]:   <os>
Nov 21 15:21:48 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:21:48 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:21:48 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:21:48 user nova-compute[74882]:   </os>
Nov 21 15:21:48 user nova-compute[74882]:   <features>
Nov 21 15:21:48 user nova-compute[74882]:     <acpi/>
Nov 21 15:21:48 user nova-compute[74882]:     <apic/>
Nov 21 15:21:48 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:21:48 user nova-compute[74882]:   </features>
Nov 21 15:21:48 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:21:48 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:21:48 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:21:48 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:21:48 user nova-compute[74882]:   </clock>
Nov 21 15:21:48 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:21:48 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:21:48 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:21:48 user nova-compute[74882]:   </cpu>
Nov 21 15:21:48 user nova-compute[74882]:   <devices>
Nov 21 15:21:48 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:21:48 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:21:48 user nova-compute[74882]:       <source dev="/dev/sdb"/>
Nov 21 15:21:48 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:21:48 user nova-compute[74882]:       <serial>13e58418-c558-4685-a396-2867666c5e76</serial>
Nov 21 15:21:48 user nova-compute[74882]:     </disk>
Nov 21 15:21:48 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:21:48 user nova-compute[74882]:       <mac address="fa:16:3e:3a:08:35"/>
Nov 21 15:21:48 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:21:48 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:21:48 user nova-compute[74882]:       <target dev="tapda4ed636-a1"/>
Nov 21 15:21:48 user nova-compute[74882]:     </interface>
Nov 21 15:21:48 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:21:48 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/2de0e971-a800-4d42-a52c-f3bdac3684db/console.log" append="off"/>
Nov 21 15:21:48 user nova-compute[74882]:     </serial>
Nov 21 15:21:48 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:21:48 user nova-compute[74882]:     <video>
Nov 21 15:21:48 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:21:48 user nova-compute[74882]:     </video>
Nov 21 15:21:48 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:21:48 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:21:48 user nova-compute[74882]:     </rng>
Nov 21 15:21:48 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:21:48 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:21:48 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:21:48 user nova-compute[74882]:     </memballoon>
Nov 21 15:21:48 user nova-compute[74882]:   </devices>
Nov 21 15:21:48 user nova-compute[74882]: </domain>
Nov 21 15:21:48 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-702719148',display_name='tempest-TestVolumeBootPattern-server-702719148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-702719148',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-vz8tfe5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:21:42Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=2de0e971-a800-4d42-a52c-f3bdac3684db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:08:35,bridge_name='br-int',has_traffic_filtering=True,id=da4ed636-a1fc-421c-9645-a79d438fdaf1,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4ed636-a1') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG os_vif [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:08:35,bridge_name='br-int',has_traffic_filtering=True,id=da4ed636-a1fc-421c-9645-a79d438fdaf1,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4ed636-a1') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fbb4699-512f-5655-85fa-209cfa62c215', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda4ed636-a1, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda4ed636-a1, col_values=(('qos', UUID('6f5a4e3d-fa5d-4ad7-b5ac-4f720824ef0b')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda4ed636-a1, col_values=(('external_ids', {'iface-id': 'da4ed636-a1fc-421c-9645-a79d438fdaf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:08:35', 'vm-uuid': '2de0e971-a800-4d42-a52c-f3bdac3684db'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:48 user nova-compute[74882]: INFO os_vif [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:08:35,bridge_name='br-int',has_traffic_filtering=True,id=da4ed636-a1fc-421c-9645-a79d438fdaf1,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4ed636-a1')
Nov 21 15:21:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:21:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No VIF found with MAC fa:16:3e:3a:08:35, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] No waiting events found dispatching network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:21:50 user nova-compute[74882]: WARNING nova.compute.manager [req-d835dcbf-d56e-44dd-b2cc-0e79c69e68a1 req-b5752387-f63e-4a8f-b2c3-1f580f88a2d5 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received unexpected event network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance with vm_state building and task_state spawning.
Nov 21 15:21:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:21:52 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Instance spawned successfully.
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:21:52 user nova-compute[74882]: INFO nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:21:52 user nova-compute[74882]: DEBUG nova.compute.manager [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] No waiting events found dispatching network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:21:52 user nova-compute[74882]: WARNING nova.compute.manager [req-34bb8642-5fd1-4760-94a8-787901585c17 req-74ceb989-e1d3-40e4-afd6-754d1cb3b824 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received unexpected event network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance with vm_state building and task_state spawning.
Nov 21 15:21:52 user nova-compute[74882]: INFO nova.compute.manager [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Took 11.41 seconds to build instance.
Nov 21 15:21:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-c6f6d3d0-957b-4fae-8481-2f6627422562 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.507s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:21:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:21:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:21:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:21:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:21:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:21:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:22:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:24 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:22:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:22:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:22:25 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:22:25 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 2de0e971-a800-4d42-a52c-f3bdac3684db {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:22:26 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:22:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:22:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:22:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:22:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:22:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:22:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:22:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:22:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:22:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:22:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:22:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:22:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=25.03949737548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2de0e971-a800-4d42-a52c-f3bdac3684db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:22:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:22:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:22:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:22:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:22:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:22:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:22:49 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:22:54 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:22:59 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:04 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:09 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:23:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:23:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:14 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:19 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:23:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:23:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:24 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:23:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:23:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:23:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:23:25 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:23:25 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 2de0e971-a800-4d42-a52c-f3bdac3684db {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:23:26 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:23:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:23:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:23:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:23:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:23:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:23:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:23:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:23:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:23:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:23:31 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:23:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:23:32 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.0389404296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2de0e971-a800-4d42-a52c-f3bdac3684db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-changed-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Refreshing instance network info cache due to event network-changed-da4ed636-a1fc-421c-9645-a79d438fdaf1. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:23:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Refreshing network info cache for port da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:23:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updated VIF entry in instance network info cache for port da4ed636-a1fc-421c-9645-a79d438fdaf1. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:23:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:23:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3df0c6d2-185f-4709-844c-c29f1c802fc9 req-a4a964b8-229e-44d0-acc8-19712c8705f3 service nova] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:23:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:34 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:23:39 user nova-compute[74882]: INFO nova.compute.claims [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Claim successful on node user
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.network.neutron [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:23:39 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:23:39 user nova-compute[74882]: DEBUG nova.policy [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27e5950baa034e029e5db136635acd29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b11227090b4d16929bdc1b9d2e8c16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:23:39 user nova-compute[74882]: INFO nova.virt.block_device [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Booting with volume d4c85311-5c93-4c65-b1fe-54c50cc12db3 at /dev/vda
Nov 21 15:23:40 user nova-compute[74882]: DEBUG os_brick.utils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d192872-1b5a-43e9-8cfe-f4462ad50f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde66625-c49e-4a1d-bacc-15d10030f057]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88d9d7-6e5b-43f5-9df1-e74515b0764f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[76785bcd-2b2c-4430-a3f1-bedb40dafac0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:23:40 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:23:40 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14325ae-c220-4803-9c18-8fea7b375201]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG os_brick.utils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updating existing volume attachment record: 3deed7bc-37cc-408e-aad6-0da01b1b52f8 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:23:40 user nova-compute[74882]: DEBUG nova.network.neutron [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Successfully created port: a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Successfully updated port: a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquired lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-changed-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.compute.manager [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Refreshing instance network info cache due to event network-changed-a3e33ccf-94ae-44a5-b4c7-338013c32c79. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Acquiring lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.network.neutron [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updating instance_info_cache with network_info: [{"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Releasing lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Instance network_info: |[{"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Acquired lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:23:41 user nova-compute[74882]: DEBUG nova.network.neutron [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Refreshing network info cache for port a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:23:42 user nova-compute[74882]: DEBUG nova.network.neutron [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updated VIF entry in instance network info cache for port a3e33ccf-94ae-44a5-b4c7-338013c32c79. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:23:42 user nova-compute[74882]: DEBUG nova.network.neutron [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updating instance_info_cache with network_info: [{"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:23:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-ecfdd3e6-85a4-432d-9633-960b15b18306 req-43169a0a-15dc-40e9-bc4d-5c578aaea59d service nova] Releasing lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:23:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:23:45 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Creating image(s)
Nov 21 15:23:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Did not create local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Ensure instance console log exists: /opt/stack/data/nova/instances/944e2207-ff51-45e6-a803-d7191a3d2a77/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Start _get_guest_xml network_info=[{"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBaFClDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '944e2207-ff51-45e6-a803-d7191a3d2a77', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4c85311-5c93-4c65-b1fe-54c50cc12db3', 'serial': 'd4c85311-5c93-4c65-b1fe-54c50cc12db3'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '3deed7bc-37cc-408e-aad6-0da01b1b52f8', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:23:45 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:23:45 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:23:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:23:45 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBaFClDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:23:46 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:23:46 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:23:46 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6eda7e-ad91-4356-9bcd-34830cf3c16b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:23:46 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3871ed72-014b-4229-bfe4-a7d13995aa69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3] added
Nov 21 15:23:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9debeb05-f3db-4162-90a1-a3df4ad70ce1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[237fb3f6-b479-4dc9-bff2-2c2e308b111d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBaFClDN {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dBaFClDN" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e92d2f-328b-40e9-9f77-7f7ec47e5ce2]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dBaFClDN'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f71310-650b-4998-b46d-6153bfb98a84]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252c799-72cb-419f-ab97-7eb1f8e9a77f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:23:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:23:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51f4d9-591b-4fbc-9e37-353753bd51e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260]
Nov 21 15:23:46 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260] successful.
Nov 21 15:23:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eca852c-59a3-4aa9-b8d2-08fe410b116f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3f19a1-74d8-47c6-aca0-e95438f689bc]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:23:46 user nova-compute[74882]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 (non-flash)
Nov 21 15:23:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:23:46 user nova-compute[74882]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 (non-flash)
Nov 21 15:23:46 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4402496-7c1d-4e27-b2c1-2e4aa5a4d219]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:23:46 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBaFClDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26639326435663532', 'path': '/dev/sdc'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639326435663532', 'path': '/dev/sdc'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1408803984',display_name='tempest-TestVolumeBootPattern-server-1408803984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1408803984',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-dx0ihekv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:23:40Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=944e2207-ff51-45e6-a803-d7191a3d2a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e33ccf-94ae-44a5-b4c7-338013c32c79,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e33ccf-94') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.objects.instance [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'pci_devices' on Instance uuid 944e2207-ff51-45e6-a803-d7191a3d2a77 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:23:47 user nova-compute[74882]:   <uuid>944e2207-ff51-45e6-a803-d7191a3d2a77</uuid>
Nov 21 15:23:47 user nova-compute[74882]:   <name>instance-00000034</name>
Nov 21 15:23:47 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:23:47 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:23:47 user nova-compute[74882]:   <metadata>
Nov 21 15:23:47 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:23:47 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:23:47 user nova-compute[74882]:       <nova:name>tempest-TestVolumeBootPattern-server-1408803984</nova:name>
Nov 21 15:23:47 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:23:45</nova:creationTime>
Nov 21 15:23:47 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:23:47 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:23:47 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:23:47 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:23:47 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:23:47 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:23:47 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:23:47 user nova-compute[74882]:       <nova:owner>
Nov 21 15:23:47 user nova-compute[74882]:         <nova:user uuid="27e5950baa034e029e5db136635acd29">tempest-TestVolumeBootPattern-2100428844-project-member</nova:user>
Nov 21 15:23:47 user nova-compute[74882]:         <nova:project uuid="52b11227090b4d16929bdc1b9d2e8c16">tempest-TestVolumeBootPattern-2100428844</nova:project>
Nov 21 15:23:47 user nova-compute[74882]:       </nova:owner>
Nov 21 15:23:47 user nova-compute[74882]:       <nova:ports>
Nov 21 15:23:47 user nova-compute[74882]:         <nova:port uuid="a3e33ccf-94ae-44a5-b4c7-338013c32c79">
Nov 21 15:23:47 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 21 15:23:47 user nova-compute[74882]:         </nova:port>
Nov 21 15:23:47 user nova-compute[74882]:       </nova:ports>
Nov 21 15:23:47 user nova-compute[74882]:     </nova:instance>
Nov 21 15:23:47 user nova-compute[74882]:   </metadata>
Nov 21 15:23:47 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:23:47 user nova-compute[74882]:     <system>
Nov 21 15:23:47 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:23:47 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:23:47 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:23:47 user nova-compute[74882]:       <entry name="serial">944e2207-ff51-45e6-a803-d7191a3d2a77</entry>
Nov 21 15:23:47 user nova-compute[74882]:       <entry name="uuid">944e2207-ff51-45e6-a803-d7191a3d2a77</entry>
Nov 21 15:23:47 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:23:47 user nova-compute[74882]:     </system>
Nov 21 15:23:47 user nova-compute[74882]:   </sysinfo>
Nov 21 15:23:47 user nova-compute[74882]:   <os>
Nov 21 15:23:47 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:23:47 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:23:47 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:23:47 user nova-compute[74882]:   </os>
Nov 21 15:23:47 user nova-compute[74882]:   <features>
Nov 21 15:23:47 user nova-compute[74882]:     <acpi/>
Nov 21 15:23:47 user nova-compute[74882]:     <apic/>
Nov 21 15:23:47 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:23:47 user nova-compute[74882]:   </features>
Nov 21 15:23:47 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:23:47 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:23:47 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:23:47 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:23:47 user nova-compute[74882]:   </clock>
Nov 21 15:23:47 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:23:47 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:23:47 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:23:47 user nova-compute[74882]:   </cpu>
Nov 21 15:23:47 user nova-compute[74882]:   <devices>
Nov 21 15:23:47 user nova-compute[74882]:     <disk type="block" device="disk">
Nov 21 15:23:47 user nova-compute[74882]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:23:47 user nova-compute[74882]:       <source dev="/dev/sdc"/>
Nov 21 15:23:47 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:23:47 user nova-compute[74882]:       <serial>d4c85311-5c93-4c65-b1fe-54c50cc12db3</serial>
Nov 21 15:23:47 user nova-compute[74882]:     </disk>
Nov 21 15:23:47 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:23:47 user nova-compute[74882]:       <mac address="fa:16:3e:a3:b3:41"/>
Nov 21 15:23:47 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:23:47 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:23:47 user nova-compute[74882]:       <target dev="tapa3e33ccf-94"/>
Nov 21 15:23:47 user nova-compute[74882]:     </interface>
Nov 21 15:23:47 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:23:47 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/944e2207-ff51-45e6-a803-d7191a3d2a77/console.log" append="off"/>
Nov 21 15:23:47 user nova-compute[74882]:     </serial>
Nov 21 15:23:47 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:23:47 user nova-compute[74882]:     <video>
Nov 21 15:23:47 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:23:47 user nova-compute[74882]:     </video>
Nov 21 15:23:47 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:23:47 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:23:47 user nova-compute[74882]:     </rng>
Nov 21 15:23:47 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:23:47 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:23:47 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:23:47 user nova-compute[74882]:     </memballoon>
Nov 21 15:23:47 user nova-compute[74882]:   </devices>
Nov 21 15:23:47 user nova-compute[74882]: </domain>
Nov 21 15:23:47 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1408803984',display_name='tempest-TestVolumeBootPattern-server-1408803984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1408803984',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-dx0ihekv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:23:40Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=944e2207-ff51-45e6-a803-d7191a3d2a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e33ccf-94ae-44a5-b4c7-338013c32c79,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e33ccf-94') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG os_vif [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e33ccf-94ae-44a5-b4c7-338013c32c79,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e33ccf-94') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '466e3a39-3395-58b7-b153-2a8f98e988ef', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3e33ccf-94, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3e33ccf-94, col_values=(('qos', UUID('325743aa-4dc2-4af5-a92f-c5f6ebdd50b6')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3e33ccf-94, col_values=(('external_ids', {'iface-id': 'a3e33ccf-94ae-44a5-b4c7-338013c32c79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b3:41', 'vm-uuid': '944e2207-ff51-45e6-a803-d7191a3d2a77'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:47 user nova-compute[74882]: INFO os_vif [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e33ccf-94ae-44a5-b4c7-338013c32c79,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e33ccf-94')
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:23:47 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] No VIF found with MAC fa:16:3e:a3:b3:41, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:23:48 user nova-compute[74882]: DEBUG nova.compute.manager [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] No waiting events found dispatching network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:23:48 user nova-compute[74882]: WARNING nova.compute.manager [req-b54de960-7557-4a57-8d85-a728ebea5130 req-3fdf80d4-271c-4635-a957-b21e144b72e8 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received unexpected event network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance with vm_state building and task_state spawning.
Nov 21 15:23:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:23:50 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Instance spawned successfully.
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.compute.manager [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] No waiting events found dispatching network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:23:50 user nova-compute[74882]: WARNING nova.compute.manager [req-50207dc4-ba48-43aa-a19e-6364dee72363 req-7d39718a-bda2-4ea9-be74-eec7c2d15fb6 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received unexpected event network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance with vm_state building and task_state spawning.
Nov 21 15:23:50 user nova-compute[74882]: INFO nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 21 15:23:50 user nova-compute[74882]: DEBUG nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:23:50 user nova-compute[74882]: INFO nova.compute.manager [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Took 11.42 seconds to build instance.
Nov 21 15:23:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02eb84c0-ba79-4120-aa75-b8d97ac1bf70 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.530s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:23:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:23:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:24:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:24:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:24:26 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:24:26 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 2de0e971-a800-4d42-a52c-f3bdac3684db {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:24:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:24:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:24:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:24:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:24:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:24:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:24:34 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:24:34 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=25.03710174560547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2de0e971-a800-4d42-a52c-f3bdac3684db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 944e2207-ff51-45e6-a803-d7191a3d2a77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:24:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:24:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:37 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:24:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:42 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:24:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:24:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 15:24:49 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 15:24:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:24:57 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:24:58 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:02 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:25:12 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:16 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:16 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 15:25:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:22 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 2de0e971-a800-4d42-a52c-f3bdac3684db {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Triggering sync for uuid 944e2207-ff51-45e6-a803-d7191a3d2a77 {{(pid=74882) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:25 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:26 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:26 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:25:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:25:26 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:25:26 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:25:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updating instance_info_cache with network_info: [{"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:25:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:25:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:25:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:25:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:25:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-changed-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:25:31 user nova-compute[74882]: DEBUG nova.compute.manager [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Refreshing instance network info cache due to event network-changed-a3e33ccf-94ae-44a5-b4c7-338013c32c79. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Acquiring lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:25:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Acquired lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:25:31 user nova-compute[74882]: DEBUG nova.network.neutron [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Refreshing network info cache for port a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updated VIF entry in instance network info cache for port a3e33ccf-94ae-44a5-b4c7-338013c32c79. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updating instance_info_cache with network_info: [{"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-dc43785b-8480-4cde-b482-71239e969b9b req-a5d23945-02ca-48e4-8429-30e83ac531a0 service nova] Releasing lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-changed-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Refreshing instance network info cache due to event network-changed-a3e33ccf-94ae-44a5-b4c7-338013c32c79. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Acquiring lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Acquired lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG nova.network.neutron [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Refreshing network info cache for port a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:32 user nova-compute[74882]: INFO nova.compute.manager [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Terminating instance
Nov 21 15:25:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:32 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-vif-unplugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] No waiting events found dispatching network-vif-unplugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.compute.manager [req-64ca47fe-71fe-48e5-913b-c2c6c3630a86 req-8c302292-c16f-46b2-83ac-06b3115970de service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-vif-unplugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updated VIF entry in instance network info cache for port a3e33ccf-94ae-44a5-b4c7-338013c32c79. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.network.neutron [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updating instance_info_cache with network_info: [{"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-789ada82-401e-4c6e-b2dc-a6c53959d04d req-bcff4a3b-f518-40a8-aa01-09cbda9496ca service nova] Releasing lock "refresh_cache-944e2207-ff51-45e6-a803-d7191a3d2a77" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:25:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Instance destroyed successfully.
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.objects.instance [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'resources' on Instance uuid 944e2207-ff51-45e6-a803-d7191a3d2a77 {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1408803984',display_name='tempest-TestVolumeBootPattern-server-1408803984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1408803984',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:23:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-dx0ihekv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:23:51Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=944e2207-ff51-45e6-a803-d7191a3d2a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "address": "fa:16:3e:a3:b3:41", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3e33ccf-94", "ovs_interfaceid": "a3e33ccf-94ae-44a5-b4c7-338013c32c79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b3:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e33ccf-94ae-44a5-b4c7-338013c32c79,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e33ccf-94') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_vif [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b3:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e33ccf-94ae-44a5-b4c7-338013c32c79,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e33ccf-94') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3e33ccf-94, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=325743aa-4dc2-4af5-a92f-c5f6ebdd50b6) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:25:33 user nova-compute[74882]: INFO os_vif [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b3:41,bridge_name='br-int',has_traffic_filtering=True,id=a3e33ccf-94ae-44a5-b4c7-338013c32c79,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3e33ccf-94')
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dBaFClDN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:25:33 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c7e623-b378-417e-9a22-8fe6b97b0a6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:25:33 user nova-compute[74882]: No targets found.
Nov 21 15:25:33 user nova-compute[74882]: iSNS:
Nov 21 15:25:33 user nova-compute[74882]: No targets found.
Nov 21 15:25:33 user nova-compute[74882]: STATIC:
Nov 21 15:25:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3
Nov 21 15:25:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:25:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:25:33 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76
Nov 21 15:25:33 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:25:33 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:25:33 user nova-compute[74882]: FIRMWARE:
Nov 21 15:25:33 user nova-compute[74882]: No targets found.
Nov 21 15:25:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:25:33 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:25:33 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5905367-7eae-4811-bec9-dc725f03cc74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bdf859-b2e5-4f23-9b70-a733cacfa6a2]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:25:33 user nova-compute[74882]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 (non-flash)
Nov 21 15:25:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:25:33 user nova-compute[74882]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 (non-flash)
Nov 21 15:25:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6b28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3'): ({'sdc'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Removing single pathed devices sdc {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd6765d-de91-49b1-808c-4aba03ecd9b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc629670-be8f-4d6a-8586-76e5fa479f09]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flushing IO for device /dev/sdc {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa14323-c283-41c0-b459-7d9009e0897f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2bc8ab-1f45-4ba1-80bc-c89dbb93703f]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] SCSI volumes sdc have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bd01288b', '/dev/disk/by-id/scsi-1SCST_BIObd01288b-f92d5f52032449ea', '/dev/disk/by-id/scsi-26639326435663532') {{(pid=85964) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 21 15:25:33 user nova-compute[74882]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_bd01288b
Nov 21 15:25:33 user nova-compute[74882]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIObd01288b-f92d5f52032449ea
Nov 21 15:25:33 user nova-compute[74882]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26639326435663532
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc9bcec-181c-48c6-b997-8621f22ba862]: (4, None) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[def98558-f77b-48b3-a75a-1f1cfc772e57]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[30995473-d4dd-4f37-8ff2-b65c45e140b9]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260]
Nov 21 15:25:33 user nova-compute[74882]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3, portal: 172.16.0.220,3260] successful.
Nov 21 15:25:33 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4c85311-5c93-4c65-b1fe-54c50cc12db3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b2941-61eb-49b9-8dd3-d22efddd1baf]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== disconnect_volume: return (306ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:25:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Deleting instance files /opt/stack/data/nova/instances/944e2207-ff51-45e6-a803-d7191a3d2a77_del
Nov 21 15:25:33 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Deletion of /opt/stack/data/nova/instances/944e2207-ff51-45e6-a803-d7191a3d2a77_del complete
Nov 21 15:25:33 user nova-compute[74882]: INFO nova.compute.manager [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 21 15:25:33 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:25:33 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:25:34 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:25:34 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Took 0.38 seconds to deallocate network for instance.
Nov 21 15:25:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:25:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74882) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 21 15:25:35 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:25:35 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.036293029785156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:35 user nova-compute[74882]: INFO nova.compute.manager [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Took 0.76 seconds to detach 1 volumes for instance.
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 2de0e971-a800-4d42-a52c-f3bdac3684db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 944e2207-ff51-45e6-a803-d7191a3d2a77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Acquiring lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] No waiting events found dispatching network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:25:35 user nova-compute[74882]: WARNING nova.compute.manager [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received unexpected event network-vif-plugged-a3e33ccf-94ae-44a5-b4c7-338013c32c79 for instance with vm_state active and task_state deleting.
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.manager [req-c079baeb-e05f-44b4-9eec-1c55628b15b4 req-b234069a-fdd4-4e1d-946e-d7578f1ec31a service nova] [instance: 944e2207-ff51-45e6-a803-d7191a3d2a77] Received event network-vif-deleted-a3e33ccf-94ae-44a5-b4c7-338013c32c79 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.282s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:35 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Deleted allocations for instance 944e2207-ff51-45e6-a803-d7191a3d2a77
Nov 21 15:25:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-07e368cb-4172-4425-ba5d-6faadab1f2fb tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "944e2207-ff51-45e6-a803-d7191a3d2a77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:25:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:25:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:25:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:25:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:26:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:26:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:26:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:26:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:26:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:26:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:26:27 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:26:27 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 2de0e971-a800-4d42-a52c-f3bdac3684db {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:26:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-changed-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Refreshing instance network info cache due to event network-changed-da4ed636-a1fc-421c-9645-a79d438fdaf1. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Acquiring lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Acquired lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.network.neutron [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Refreshing network info cache for port da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:26:30 user nova-compute[74882]: INFO nova.compute.manager [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Terminating instance
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-vif-unplugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] No waiting events found dispatching network-vif-unplugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.compute.manager [req-12c711ab-2987-46d5-89a6-d4bdcdac79df req-3ae17510-6111-476c-9846-5668abfdc0f1 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-vif-unplugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.network.neutron [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updated VIF entry in instance network info cache for port da4ed636-a1fc-421c-9645-a79d438fdaf1. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.network.neutron [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [{"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-89f02171-1892-4407-b58f-7c45c2bfdce9 req-7ab6efa1-ded3-4994-8374-8d4f0b7a2228 service nova] Releasing lock "refresh_cache-2de0e971-a800-4d42-a52c-f3bdac3684db" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:26:30 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Instance destroyed successfully.
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.objects.instance [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lazy-loading 'resources' on Instance uuid 2de0e971-a800-4d42-a52c-f3bdac3684db {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-702719148',display_name='tempest-TestVolumeBootPattern-server-702719148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-702719148',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3CTYSTdWXUuG5j5bT1YUvgsB83M9x1dKmfsOO373p6+TThGPVwuVkuGPGq/MmC6gk9BpbZEoTQ3g45cK6GSFRXkqtc7/iToqHulTEi6qcPlM8ARyWcp6Ibzx6EjL05Vw==',key_name='tempest-TestVolumeBootPattern-74226086',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:21:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52b11227090b4d16929bdc1b9d2e8c16',ramdisk_id='',reservation_id='r-vz8tfe5g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2100428844',owner_user_name='tempest-TestVolumeBootPattern-2100428844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:21:53Z,user_data=None,user_id='27e5950baa034e029e5db136635acd29',uuid=2de0e971-a800-4d42-a52c-f3bdac3684db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converting VIF {"id": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "address": "fa:16:3e:3a:08:35", "network": {"id": "b528d921-8d48-4a36-8fdb-d38b79d20a80", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-265083514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52b11227090b4d16929bdc1b9d2e8c16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4ed636-a1", "ovs_interfaceid": "da4ed636-a1fc-421c-9645-a79d438fdaf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:08:35,bridge_name='br-int',has_traffic_filtering=True,id=da4ed636-a1fc-421c-9645-a79d438fdaf1,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4ed636-a1') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG os_vif [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:08:35,bridge_name='br-int',has_traffic_filtering=True,id=da4ed636-a1fc-421c-9645-a79d438fdaf1,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4ed636-a1') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda4ed636-a1, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f5a4e3d-fa5d-4ad7-b5ac-4f720824ef0b) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:26:30 user nova-compute[74882]: INFO os_vif [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:08:35,bridge_name='br-int',has_traffic_filtering=True,id=da4ed636-a1fc-421c-9645-a79d438fdaf1,network=Network(b528d921-8d48-4a36-8fdb-d38b79d20a80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4ed636-a1')
Nov 21 15:26:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:26:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAtqoxak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:26:31 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0612dd-be1d-45f6-87c2-021a5481b08c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:26:31 user nova-compute[74882]: No targets found.
Nov 21 15:26:31 user nova-compute[74882]: iSNS:
Nov 21 15:26:31 user nova-compute[74882]: No targets found.
Nov 21 15:26:31 user nova-compute[74882]: STATIC:
Nov 21 15:26:31 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76
Nov 21 15:26:31 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:26:31 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:26:31 user nova-compute[74882]: FIRMWARE:
Nov 21 15:26:31 user nova-compute[74882]: No targets found.
Nov 21 15:26:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:26:31 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:26:31 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42fb2c8-4111-4c78-950a-5030cc1237d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f68d2c-60e1-44e0-bbd3-4d13250645d0]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:26:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 (non-flash)
Nov 21 15:26:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c64a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a401502-ee10-4ac9-a524-861d6e946158]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bf8231-617d-4e4a-8957-8f920ee30827]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[52296457-339e-487f-8f88-5c7b83372ace]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b04825-cd04-4bff-ab41-466cc00e842a]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8a791aff-600ad941a38f7395', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8a791aff', '/dev/disk/by-id/scsi-23630306164393431') {{(pid=85964) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c7f1cc-5882-4e98-af4e-8af723b6e791]: (4, None) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c25a8d-5782-49ec-8e48-a8beb02413a5]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[90566833-eb96-49dc-bb93-1443e6631b53]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260]
Nov 21 15:26:31 user nova-compute[74882]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76, portal: 172.16.0.220,3260] successful.
Nov 21 15:26:31 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13e58418-c558-4685-a396-2867666c5e76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5859b0f5-b54f-428f-9735-4f8bdc761b47]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] <== disconnect_volume: return (292ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:26:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Deleting instance files /opt/stack/data/nova/instances/2de0e971-a800-4d42-a52c-f3bdac3684db_del
Nov 21 15:26:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Deletion of /opt/stack/data/nova/instances/2de0e971-a800-4d42-a52c-f3bdac3684db_del complete
Nov 21 15:26:31 user nova-compute[74882]: INFO nova.compute.manager [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 21 15:26:31 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:26:31 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:26:31 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Took 0.47 seconds to deallocate network for instance.
Nov 21 15:26:32 user nova-compute[74882]: INFO nova.compute.manager [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Took 0.72 seconds to detach 1 volumes for instance.
Nov 21 15:26:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Acquiring lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] No waiting events found dispatching network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:26:32 user nova-compute[74882]: WARNING nova.compute.manager [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received unexpected event network-vif-plugged-da4ed636-a1fc-421c-9645-a79d438fdaf1 for instance with vm_state active and task_state deleting.
Nov 21 15:26:32 user nova-compute[74882]: DEBUG nova.compute.manager [req-d37adb56-adad-40f9-88e2-e4433fd706f1 req-80b819b7-dd77-4fe8-93a5-ff0d050b57d5 service nova] [instance: 2de0e971-a800-4d42-a52c-f3bdac3684db] Received event network-vif-deleted-da4ed636-a1fc-421c-9645-a79d438fdaf1 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:26:32 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Deleted allocations for instance 2de0e971-a800-4d42-a52c-f3bdac3684db
Nov 21 15:26:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-168a7060-765c-4c54-a547-2a790e733d36 tempest-TestVolumeBootPattern-2100428844 tempest-TestVolumeBootPattern-2100428844-project-member] Lock "2de0e971-a800-4d42-a52c-f3bdac3684db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:26:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:26:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:26:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:26:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:26:34 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:26:34 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:26:34 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9077MB free_disk=25.035388946533203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:26:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:26:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:26:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:26:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:26:35 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:26:35 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:26:35 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:26:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:26:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:26:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:26:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:27 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:27 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:27:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:27:27 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:27:29 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:27:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:27:36 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:27:36 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:27:36 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9212MB free_disk=25.034099578857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:27:36 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:27:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:27:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:27:37 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:27:37 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:27:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:27:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:27:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:27:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:27:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:27:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:27:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:07 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Starting instance... {{(pid=74882) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74882) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 21 15:28:13 user nova-compute[74882]: INFO nova.compute.claims [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Claim successful on node user
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Start building networks asynchronously for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Allocating IP information in the background. {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] allocate_for_instance() {{(pid=74882) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Start building block device mappings for instance. {{(pid=74882) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.policy [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b231abfef6e430f869eca46aeb5d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499fb4b9492840f78205dc376e869d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74882) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Start spawning the instance on the hypervisor. {{(pid=74882) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Creating instance directory {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 21 15:28:13 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Creating image(s)
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "/opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "/opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.207s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk 1073741824 {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d,backing_fmt=raw /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk 1073741824" returned: 0 in 0.060s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "aac12dd1600c64b2b2fdf48758857bd03ec9013d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d --force-share --output=json" returned: 0 in 0.199s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk. size=1073741824 {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Successfully created port: c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG nova.virt.disk.api [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Cannot resize image /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk to a smaller size. {{(pid=74882) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Created local disks {{(pid=74882) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Ensure instance console log exists: /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/console.log {{(pid=74882) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:14 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Successfully updated port: c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Building network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-changed-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.compute.manager [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Refreshing instance network info cache due to event network-changed-c7291df2-b001-4983-a875-118cf94bdbd5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Instance cache missing network info. {{(pid=74882) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.neutron [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Instance network_info: |[{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74882) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.neutron [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Refreshing network info cache for port c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Start _get_guest_xml network_info=[{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_options': None, 'encrypted': False, 'guest_format': None, 'encryption_format': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '56f0cfc7-adc4-437a-accc-8a2f8cd4e785'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 21 15:28:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:28:15 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CPU controller missing on host. {{(pid=74882) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.host [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CPU controller found on host. {{(pid=74882) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74882) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-21T14:13:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-21T14:13:50Z,direct_url=<?>,disk_format='qcow2',id=56f0cfc7-adc4-437a-accc-8a2f8cd4e785,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c0cde27a75e6492fba3c45c9054a2c4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-21T14:13:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flavor limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Image limits 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flavor pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Image pref 0:0:0 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Got 1 possible topologies {{(pid=74882) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.hardware [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74882) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1145802285',display_name='tempest-SnapshotDataIntegrityTests-server-1145802285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1145802285',id=53,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1oeHY/5rN1gUrkAKf/4+33RT7/k37VGtmoc5W/wbQ4jyH7nbMrWDqOGR+N2bB54lcmqY01foylD3tqGegEUEJxZhiU4MOwIyw/1hCYuK0+/Hve3EzLI3dEW2K0lYOjw==',key_name='tempest-keypair-1612647852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499fb4b9492840f78205dc376e869d28',ramdisk_id='',reservation_id='r-1jefj0ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1764212604',owner_user_name='tempest-SnapshotDataIntegrityTests-1764212604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:28:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b231abfef6e430f869eca46aeb5d063',uuid=5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74882) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Converting VIF {"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=c7291df2-b001-4983-a875-118cf94bdbd5,network=Network(61623a42-185f-4a0f-ac9c-7d93ceb28acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7291df2-b0') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.objects.instance [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] End _get_guest_xml xml=<domain type="kvm">
Nov 21 15:28:15 user nova-compute[74882]:   <uuid>5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb</uuid>
Nov 21 15:28:15 user nova-compute[74882]:   <name>instance-00000035</name>
Nov 21 15:28:15 user nova-compute[74882]:   <memory>524288</memory>
Nov 21 15:28:15 user nova-compute[74882]:   <vcpu>1</vcpu>
Nov 21 15:28:15 user nova-compute[74882]:   <metadata>
Nov 21 15:28:15 user nova-compute[74882]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 21 15:28:15 user nova-compute[74882]:       <nova:package version="0.0.0"/>
Nov 21 15:28:15 user nova-compute[74882]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1145802285</nova:name>
Nov 21 15:28:15 user nova-compute[74882]:       <nova:creationTime>2023-11-21 15:28:15</nova:creationTime>
Nov 21 15:28:15 user nova-compute[74882]:       <nova:flavor name="m1.tiny">
Nov 21 15:28:15 user nova-compute[74882]:         <nova:memory>512</nova:memory>
Nov 21 15:28:15 user nova-compute[74882]:         <nova:disk>1</nova:disk>
Nov 21 15:28:15 user nova-compute[74882]:         <nova:swap>0</nova:swap>
Nov 21 15:28:15 user nova-compute[74882]:         <nova:ephemeral>0</nova:ephemeral>
Nov 21 15:28:15 user nova-compute[74882]:         <nova:vcpus>1</nova:vcpus>
Nov 21 15:28:15 user nova-compute[74882]:       </nova:flavor>
Nov 21 15:28:15 user nova-compute[74882]:       <nova:owner>
Nov 21 15:28:15 user nova-compute[74882]:         <nova:user uuid="0b231abfef6e430f869eca46aeb5d063">tempest-SnapshotDataIntegrityTests-1764212604-project-member</nova:user>
Nov 21 15:28:15 user nova-compute[74882]:         <nova:project uuid="499fb4b9492840f78205dc376e869d28">tempest-SnapshotDataIntegrityTests-1764212604</nova:project>
Nov 21 15:28:15 user nova-compute[74882]:       </nova:owner>
Nov 21 15:28:15 user nova-compute[74882]:       <nova:root type="image" uuid="56f0cfc7-adc4-437a-accc-8a2f8cd4e785"/>
Nov 21 15:28:15 user nova-compute[74882]:       <nova:ports>
Nov 21 15:28:15 user nova-compute[74882]:         <nova:port uuid="c7291df2-b001-4983-a875-118cf94bdbd5">
Nov 21 15:28:15 user nova-compute[74882]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 21 15:28:15 user nova-compute[74882]:         </nova:port>
Nov 21 15:28:15 user nova-compute[74882]:       </nova:ports>
Nov 21 15:28:15 user nova-compute[74882]:     </nova:instance>
Nov 21 15:28:15 user nova-compute[74882]:   </metadata>
Nov 21 15:28:15 user nova-compute[74882]:   <sysinfo type="smbios">
Nov 21 15:28:15 user nova-compute[74882]:     <system>
Nov 21 15:28:15 user nova-compute[74882]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 21 15:28:15 user nova-compute[74882]:       <entry name="product">OpenStack Nova</entry>
Nov 21 15:28:15 user nova-compute[74882]:       <entry name="version">0.0.0</entry>
Nov 21 15:28:15 user nova-compute[74882]:       <entry name="serial">5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb</entry>
Nov 21 15:28:15 user nova-compute[74882]:       <entry name="uuid">5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb</entry>
Nov 21 15:28:15 user nova-compute[74882]:       <entry name="family">Virtual Machine</entry>
Nov 21 15:28:15 user nova-compute[74882]:     </system>
Nov 21 15:28:15 user nova-compute[74882]:   </sysinfo>
Nov 21 15:28:15 user nova-compute[74882]:   <os>
Nov 21 15:28:15 user nova-compute[74882]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 21 15:28:15 user nova-compute[74882]:     <boot dev="hd"/>
Nov 21 15:28:15 user nova-compute[74882]:     <smbios mode="sysinfo"/>
Nov 21 15:28:15 user nova-compute[74882]:   </os>
Nov 21 15:28:15 user nova-compute[74882]:   <features>
Nov 21 15:28:15 user nova-compute[74882]:     <acpi/>
Nov 21 15:28:15 user nova-compute[74882]:     <apic/>
Nov 21 15:28:15 user nova-compute[74882]:     <vmcoreinfo/>
Nov 21 15:28:15 user nova-compute[74882]:   </features>
Nov 21 15:28:15 user nova-compute[74882]:   <clock offset="utc">
Nov 21 15:28:15 user nova-compute[74882]:     <timer name="pit" tickpolicy="delay"/>
Nov 21 15:28:15 user nova-compute[74882]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 21 15:28:15 user nova-compute[74882]:     <timer name="hpet" present="no"/>
Nov 21 15:28:15 user nova-compute[74882]:   </clock>
Nov 21 15:28:15 user nova-compute[74882]:   <cpu mode="custom" match="exact">
Nov 21 15:28:15 user nova-compute[74882]:     <model>Nehalem</model>
Nov 21 15:28:15 user nova-compute[74882]:     <topology sockets="1" cores="1" threads="1"/>
Nov 21 15:28:15 user nova-compute[74882]:   </cpu>
Nov 21 15:28:15 user nova-compute[74882]:   <devices>
Nov 21 15:28:15 user nova-compute[74882]:     <disk type="file" device="disk">
Nov 21 15:28:15 user nova-compute[74882]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 21 15:28:15 user nova-compute[74882]:       <source file="/opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk"/>
Nov 21 15:28:15 user nova-compute[74882]:       <target dev="vda" bus="virtio"/>
Nov 21 15:28:15 user nova-compute[74882]:     </disk>
Nov 21 15:28:15 user nova-compute[74882]:     <interface type="ethernet">
Nov 21 15:28:15 user nova-compute[74882]:       <mac address="fa:16:3e:1b:28:c0"/>
Nov 21 15:28:15 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:28:15 user nova-compute[74882]:       <mtu size="1442"/>
Nov 21 15:28:15 user nova-compute[74882]:       <target dev="tapc7291df2-b0"/>
Nov 21 15:28:15 user nova-compute[74882]:     </interface>
Nov 21 15:28:15 user nova-compute[74882]:     <serial type="pty">
Nov 21 15:28:15 user nova-compute[74882]:       <log file="/opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/console.log" append="off"/>
Nov 21 15:28:15 user nova-compute[74882]:     </serial>
Nov 21 15:28:15 user nova-compute[74882]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 21 15:28:15 user nova-compute[74882]:     <video>
Nov 21 15:28:15 user nova-compute[74882]:       <model type="virtio"/>
Nov 21 15:28:15 user nova-compute[74882]:     </video>
Nov 21 15:28:15 user nova-compute[74882]:     <rng model="virtio">
Nov 21 15:28:15 user nova-compute[74882]:       <backend model="random">/dev/urandom</backend>
Nov 21 15:28:15 user nova-compute[74882]:     </rng>
Nov 21 15:28:15 user nova-compute[74882]:     <controller type="usb" index="0" model="none"/>
Nov 21 15:28:15 user nova-compute[74882]:     <memballoon model="virtio">
Nov 21 15:28:15 user nova-compute[74882]:       <stats period="10"/>
Nov 21 15:28:15 user nova-compute[74882]:     </memballoon>
Nov 21 15:28:15 user nova-compute[74882]:   </devices>
Nov 21 15:28:15 user nova-compute[74882]: </domain>
Nov 21 15:28:15 user nova-compute[74882]:  {{(pid=74882) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1145802285',display_name='tempest-SnapshotDataIntegrityTests-server-1145802285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1145802285',id=53,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1oeHY/5rN1gUrkAKf/4+33RT7/k37VGtmoc5W/wbQ4jyH7nbMrWDqOGR+N2bB54lcmqY01foylD3tqGegEUEJxZhiU4MOwIyw/1hCYuK0+/Hve3EzLI3dEW2K0lYOjw==',key_name='tempest-keypair-1612647852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='499fb4b9492840f78205dc376e869d28',ramdisk_id='',reservation_id='r-1jefj0ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1764212604',owner_user_name='tempest-SnapshotDataIntegrityTests-1764212604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-21T15:28:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b231abfef6e430f869eca46aeb5d063',uuid=5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Converting VIF {"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=c7291df2-b001-4983-a875-118cf94bdbd5,network=Network(61623a42-185f-4a0f-ac9c-7d93ceb28acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7291df2-b0') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG os_vif [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=c7291df2-b001-4983-a875-118cf94bdbd5,network=Network(61623a42-185f-4a0f-ac9c-7d93ceb28acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7291df2-b0') {{(pid=74882) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9a272c9-d66b-5ca3-86dd-de70633c4b84', '_type': 'linux-noop'}}, row=False) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7291df2-b0, may_exist=True, interface_attrs={}) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7291df2-b0, col_values=(('qos', UUID('c3668174-0ffe-4e7f-a1c3-0271abb7e73d')),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7291df2-b0, col_values=(('external_ids', {'iface-id': 'c7291df2-b001-4983-a875-118cf94bdbd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:28:c0', 'vm-uuid': '5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb'}),), if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:28:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:15 user nova-compute[74882]: INFO os_vif [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=c7291df2-b001-4983-a875-118cf94bdbd5,network=Network(61623a42-185f-4a0f-ac9c-7d93ceb28acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7291df2-b0')
Nov 21 15:28:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:28:16 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No VIF found with MAC fa:16:3e:1b:28:c0, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:28:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated VIF entry in instance network info cache for port c7291df2-b001-4983-a875-118cf94bdbd5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:28:16 user nova-compute[74882]: DEBUG nova.network.neutron [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:28:16 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-4875067c-a826-4160-9584-85f5431d7584 req-761d68cd-0739-43b6-9ee2-14c54d5235db service nova] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:17 user nova-compute[74882]: DEBUG nova.compute.manager [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] No waiting events found dispatching network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:28:17 user nova-compute[74882]: WARNING nova.compute.manager [req-823c41fc-690e-4cd3-a529-f03e60af6fb0 req-fb0a4c00-b9b2-4bbf-9252-2542a208d904 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received unexpected event network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 for instance with vm_state building and task_state spawning.
Nov 21 15:28:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Instance event wait completed in 0 seconds for  {{(pid=74882) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Guest created on hypervisor {{(pid=74882) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 21 15:28:19 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Instance spawned successfully.
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.compute.manager [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] No waiting events found dispatching network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:28:19 user nova-compute[74882]: WARNING nova.compute.manager [req-7b664d33-fa83-4722-8312-743c94664bfa req-8adbef98-0c2f-41de-8dca-a47348953166 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received unexpected event network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 for instance with vm_state building and task_state spawning.
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Found default for hw_cdrom_bus of ide {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Found default for hw_disk_bus of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Found default for hw_input_bus of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Found default for hw_pointer_model of None {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Found default for hw_video_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Found default for hw_vif_model of virtio {{(pid=74882) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 21 15:28:19 user nova-compute[74882]: INFO nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 21 15:28:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Checking state {{(pid=74882) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 21 15:28:20 user nova-compute[74882]: INFO nova.compute.manager [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Took 6.69 seconds to build instance.
Nov 21 15:28:20 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-55dd0add-d039-46af-9159-67fb7c92e109 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.839s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:28:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:29 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:28:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:28:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:28:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:31 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:28:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:28:37 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:28:38 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:28:38 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:28:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=24.992069244384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:28:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:28:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:44 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:28:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:28:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:29:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:29:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:25 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:29:28 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:29:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:29:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:29:28 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:29:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:29:29 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:29:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:29:29 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:29:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:29:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:29:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:29:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:29:30 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:29:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:35 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:29:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:29:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:29:40 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:29:40 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:29:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=24.98883056640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:29:40 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:29:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:29:45 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:29:55 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:29:59 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:30:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:30:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:30:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:30:00 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:03 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 15:30:03 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-changed-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG nova.compute.manager [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Refreshing instance network info cache due to event network-changed-c7291df2-b001-4983-a875-118cf94bdbd5. {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Refreshing network info cache for port c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated VIF entry in instance network info cache for port c7291df2-b001-4983-a875-118cf94bdbd5. {{(pid=74882) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG nova.network.neutron [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:30:04 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-26804f38-4ada-45b1-8abc-334b5083d290 req-581a1a6d-536d-450f-a791-84218b094d28 service nova] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:30:05 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:30:07 user nova-compute[74882]: INFO nova.compute.manager [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attaching volume d0014d9a-54c6-4350-9a98-c42b738737e0 to /dev/vdb
Nov 21 15:30:07 user nova-compute[74882]: DEBUG os_brick.utils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d062d3-e704-480c-b80b-aa4cbda39865]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6b45de-ea42-4105-a123-0098c0a972a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbccc91-1132-4de2-a029-32a36a87539b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d9ac08-0ea8-47e1-a5d2-768ab90800c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:30:07 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:30:07 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3223789-395f-4b87-a4c3-c93eb48e4f88]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:30:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:30:08 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:30:08 user nova-compute[74882]: DEBUG os_brick.utils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:30:08 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating existing volume attachment record: 6d76b686-91a1-470e-bdfc-45c0998aefa5 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:30:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:10 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfdtwOeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:30:13 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:30:13 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:30:13 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[369432b7-02bd-466f-bb9a-629031ff98ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:30:13 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c363a848-967e-4f6e-87ad-1de4d0a5fc4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0] added
Nov 21 15:30:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d86020-8efe-4c82-901c-f819741921cc]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47f5e3-ceae-4b10-accc-e2c1fb6b1e8c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfdtwOeC {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfdtwOeC" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e30d50-b2de-4135-8c7e-e387a1146875]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PfdtwOeC'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfec6d39-ce57-4016-bec3-4cd315504e3d]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dced32f1-524d-4754-95b8-1c0cfe35eb0b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:30:13 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:30:13 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:30:13 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:30:13 user nova-compute[74882]: 
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a522ce7e-c8ee-461e-94bb-43a28d6cb912]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260]
Nov 21 15:30:13 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260] successful.
Nov 21 15:30:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6df710-0ce3-441d-adfb-69ddf255a671]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec1086b-3c9d-4be8-85a7-579e6b5648b5]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 (non-flash)
Nov 21 15:30:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 (non-flash)
Nov 21 15:30:13 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988d689-d36c-4dcf-9473-0a030a3f4432]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:13 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:30:14 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:30:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfdtwOeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:30:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:30:14 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23763623933613839', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:30:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763623933613839', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:30:14 user nova-compute[74882]: DEBUG nova.objects.instance [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:30:14 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 15:30:14 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:30:14 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:30:14 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:30:14 user nova-compute[74882]:   <serial>d0014d9a-54c6-4350-9a98-c42b738737e0</serial>
Nov 21 15:30:14 user nova-compute[74882]: </disk>
Nov 21 15:30:14 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 15:30:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:30:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:30:15 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No VIF found with MAC fa:16:3e:1b:28:c0, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:30:15 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-bb8b9c04-3e78-46bd-a0f0-df365c04d124 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.554s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:30:15 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:19 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:19 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 15:30:20 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:30:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:30:28 user nova-compute[74882]: INFO nova.compute.manager [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Detaching volume d0014d9a-54c6-4350-9a98-c42b738737e0
Nov 21 15:30:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:28 user nova-compute[74882]: INFO nova.virt.block_device [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attempting to driver detach volume d0014d9a-54c6-4350-9a98-c42b738737e0 from mountpoint /dev/vdb
Nov 21 15:30:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Attempting to detach device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 15:30:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:30:28 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:30:28 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:30:28 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:30:28 user nova-compute[74882]:   <serial>d0014d9a-54c6-4350-9a98-c42b738737e0</serial>
Nov 21 15:30:28 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:30:28 user nova-compute[74882]: </disk>
Nov 21 15:30:28 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:30:28 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config.
Nov 21 15:30:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 15:30:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:30:28 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:30:28 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:30:28 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:30:28 user nova-compute[74882]:   <serial>d0014d9a-54c6-4350-9a98-c42b738737e0</serial>
Nov 21 15:30:28 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:30:28 user nova-compute[74882]: </disk>
Nov 21 15:30:28 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:30:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 15:30:30 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:30:30 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:30:30 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:30:30 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:30:30 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:30:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:31 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:30:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:30:31 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:30:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:30:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:30:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:39 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:40 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:30:40 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=24.987525939941406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:30:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:30:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:30:46 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:30:49 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb is timed out.
Nov 21 15:30:49 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config.
Nov 21 15:30:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfdtwOeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:30:49 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9f2009-b969-42a3-9b9a-71e5064e45a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:30:49 user nova-compute[74882]: No targets found.
Nov 21 15:30:49 user nova-compute[74882]: iSNS:
Nov 21 15:30:49 user nova-compute[74882]: No targets found.
Nov 21 15:30:49 user nova-compute[74882]: STATIC:
Nov 21 15:30:49 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0
Nov 21 15:30:49 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:30:49 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:30:49 user nova-compute[74882]: FIRMWARE:
Nov 21 15:30:49 user nova-compute[74882]: No targets found.
Nov 21 15:30:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:30:49 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:30:49 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56db564-345d-40bf-ad45-40d4ca046eb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[01400233-d9a5-4f10-8520-8940a84fe999]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 (non-flash)
Nov 21 15:30:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 (non-flash)
Nov 21 15:30:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c6b1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66653e-b13e-458b-8024-2e89bfe13705]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b967f-b0ac-4594-af34-9f04fdc450f6]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdef0671-11b7-417c-a73f-17e943f532d1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.120s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d8e4a-9128-408c-b883-08f93e95c39b]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed5c29b-ab10-41fa-be95-b9e333ee6869]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21c7e4b-20eb-43cc-a0fc-eec7f2054482]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260]
Nov 21 15:30:49 user nova-compute[74882]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0, portal: 172.16.0.220,3260] successful.
Nov 21 15:30:49 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0014d9a-54c6-4350-9a98-c42b738737e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d6926-65a1-4e40-b1a5-499843b7dd20]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== disconnect_volume: return (350ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:30:49 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:30:50 user nova-compute[74882]: DEBUG nova.objects.instance [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:30:50 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-febc4297-257b-48ca-9d03-9896baafcabf tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:30:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:30:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG nova.objects.instance [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:31:21 user nova-compute[74882]: INFO nova.compute.manager [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attaching volume 06219637-9551-4ac9-8d20-877de3340b2d to /dev/vdb
Nov 21 15:31:21 user nova-compute[74882]: DEBUG os_brick.utils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[191cec69-3cde-4294-9bfa-2785fb078bb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:21 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ed0efd-cb49-4624-99cb-13416589a7fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[536141de-6b8b-4be8-be85-39966d6c8015]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c01e96-cd6b-4d57-a721-d9b5cd6efc12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:31:22 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:31:22 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a5fe9c-8671-489a-b44b-ede3dbc4b85f]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG os_brick.utils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:31:22 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating existing volume attachment record: f6856f6a-ffde-4448-80f3-5f61ed2631c9 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:31:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTHWtIPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:31:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:31:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:31:27 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3d1610-006c-4634-bccc-b0b06346071f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:31:27 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e415d4a6-7e7c-48a6-9f20-c18aa182cdab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d] added
Nov 21 15:31:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fe020c-0667-4ff8-923f-4750237f31ca]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79f857-2303-47c8-91f8-16ddcc9429b5]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTHWtIPk {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nTHWtIPk" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dcc6bc-c691-4e88-8366-34b692d5a731]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nTHWtIPk'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b716e0b-eda6-48e1-bb0a-2b49a03fbcc0]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff871fad-a2d4-439d-bb6e-eafbc858ba13]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:31:27 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:31:27 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:31:27 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:31:27 user nova-compute[74882]: 
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[32403b03-d868-4627-8756-20dca898acbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260]
Nov 21 15:31:27 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260] successful.
Nov 21 15:31:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfa9bae-80c6-4154-9efb-947f6ce2d9bb]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a53068c-4dd8-461b-bee8-fdb5d6d6647d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d (non-flash)
Nov 21 15:31:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d (non-flash)
Nov 21 15:31:27 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.229s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c278b19d-5a51-4a81-9a32-39b4e80ffc65]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:27 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:31:28 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:31:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTHWtIPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:31:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.257s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:31:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '26434383835626331', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434383835626331', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:31:28 user nova-compute[74882]: DEBUG nova.objects.instance [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:31:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 15:31:28 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:31:28 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:31:28 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:31:28 user nova-compute[74882]:   <serial>06219637-9551-4ac9-8d20-877de3340b2d</serial>
Nov 21 15:31:28 user nova-compute[74882]: </disk>
Nov 21 15:31:28 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 15:31:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:31:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:31:29 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No VIF found with MAC fa:16:3e:1b:28:c0, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:31:29 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-02ae5848-528f-4fef-a819-b7989134754c tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.479s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:31:31 user nova-compute[74882]: INFO nova.compute.manager [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Detaching volume 06219637-9551-4ac9-8d20-877de3340b2d
Nov 21 15:31:31 user nova-compute[74882]: INFO nova.virt.block_device [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attempting to driver detach volume 06219637-9551-4ac9-8d20-877de3340b2d from mountpoint /dev/vdb
Nov 21 15:31:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Attempting to detach device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:31:31 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:31:31 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:31:31 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:31:31 user nova-compute[74882]:   <serial>06219637-9551-4ac9-8d20-877de3340b2d</serial>
Nov 21 15:31:31 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:31:31 user nova-compute[74882]: </disk>
Nov 21 15:31:31 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:31:31 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config.
Nov 21 15:31:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:31:31 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:31:31 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:31:31 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:31:31 user nova-compute[74882]:   <serial>06219637-9551-4ac9-8d20-877de3340b2d</serial>
Nov 21 15:31:31 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:31:31 user nova-compute[74882]: </disk>
Nov 21 15:31:31 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:31:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 15:31:32 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:31:32 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:31:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:31:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:31:32 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:31:32 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:31:33 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:31:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:31:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:31:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:35 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:31:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:40 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:31:41 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:31:41 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:31:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8928MB free_disk=24.98657989501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:31:41 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:31:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:31:51 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb is timed out.
Nov 21 15:31:51 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config.
Nov 21 15:31:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nTHWtIPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:31:51 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c9fa12-d020-4561-beb5-7a107aef8e32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:31:51 user nova-compute[74882]: No targets found.
Nov 21 15:31:51 user nova-compute[74882]: iSNS:
Nov 21 15:31:51 user nova-compute[74882]: No targets found.
Nov 21 15:31:51 user nova-compute[74882]: STATIC:
Nov 21 15:31:51 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d
Nov 21 15:31:51 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:31:51 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:31:51 user nova-compute[74882]: FIRMWARE:
Nov 21 15:31:51 user nova-compute[74882]: No targets found.
Nov 21 15:31:51 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:31:51 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:31:51 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9a131-2301-4e70-9aad-18253e32ae06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f8b54b-9dc7-4961-8603-24d3e128dd7c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d (non-flash)
Nov 21 15:31:51 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d (non-flash)
Nov 21 15:31:51 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c732830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb21224d-f01e-4ffd-9ea9-598c429ddc6b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ba0bf2-0360-4eae-9fbd-c224037dcdfa]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1fae1e-571b-479c-9f10-79478d42a8a1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a344a9bc-a556-4cda-bad2-62dffd4fd735]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da40fe-ef6d-478f-8c7f-5b6ef77d6c6f]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3434bd2a-6b48-4d2f-a9f7-796d4e98f79e]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260]
Nov 21 15:31:51 user nova-compute[74882]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d, portal: 172.16.0.220,3260] successful.
Nov 21 15:31:51 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06219637-9551-4ac9-8d20-877de3340b2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0267cb7b-7c68-447f-b698-dcabce9d2260]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== disconnect_volume: return (272ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:31:51 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:31:52 user nova-compute[74882]: DEBUG nova.objects.instance [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:31:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-dbe0ab69-5e36-4fba-9d72-61240dd80ba6 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.543s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:31:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:32:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:32:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:32:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:32:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:32:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:32:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:32:24 user nova-compute[74882]: INFO nova.compute.manager [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attaching volume 26fe9f56-ae93-4cc8-be2d-8a872116ee3b to /dev/vdb
Nov 21 15:32:24 user nova-compute[74882]: DEBUG os_brick.utils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc099012-20dc-4999-93ae-18faffe899ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caa0bf1-972e-4dc0-a56b-9d2b5ee88432]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[58993610-2381-4622-83a6-d8d1b307d838]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7bb795-d28f-49c2-b19e-cc6114529ef8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:32:24 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:32:24 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4020f06-3de2-4572-95f7-5298e428ca78]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG os_brick.utils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:32:24 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating existing volume attachment record: 5e408dfb-f507-4edb-afd0-9ac7767408f2 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:32:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwMZDaGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:32:30 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:32:30 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:32:30 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a273b-da83-4c92-ad77-ee24a720cca7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:32:30 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[752252a9-3852-44df-85b9-083f1df44b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b] added
Nov 21 15:32:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27fc153-dec8-4de9-90ae-5086ebaa65f5]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb873566-b2ca-47ab-93ff-89f2e9af39a1]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwMZDaGE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwMZDaGE" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3ee46f-1f06-4aa9-bd0e-5a6c656df234]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UwMZDaGE'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f498e6-5b2d-4251-8067-97f7ee26eef6]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c57d91-1dab-4ffe-9669-0575601770a8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:32:30 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:32:30 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:32:30 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:32:30 user nova-compute[74882]: 
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e18eec-c0e3-4e9b-b4ad-808f8e435096]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260]
Nov 21 15:32:30 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260] successful.
Nov 21 15:32:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c91b0-6288-4b45-9462-38208bcaa146]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b6e96-6adb-4d7e-a777-8e9cb403c7ff]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b (non-flash)
Nov 21 15:32:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b (non-flash)
Nov 21 15:32:30 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d53a703-9c8a-419b-b74c-015464bec0e0]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:32:30 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwMZDaGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:32:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:32:31 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26130383532313239', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:32:31 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130383532313239', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:32:31 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:32:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 15:32:32 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:32:32 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:32:32 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:32:32 user nova-compute[74882]:   <serial>26fe9f56-ae93-4cc8-be2d-8a872116ee3b</serial>
Nov 21 15:32:32 user nova-compute[74882]: </disk>
Nov 21 15:32:32 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 15:32:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:32:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:32:32 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No VIF found with MAC fa:16:3e:1b:28:c0, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:32:32 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7f65b477-4144-45ff-a1d5-886abb339639 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.109s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:32:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:34 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:32:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:32:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:32:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:32:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:32:34 user nova-compute[74882]: INFO nova.compute.manager [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Detaching volume 26fe9f56-ae93-4cc8-be2d-8a872116ee3b
Nov 21 15:32:34 user nova-compute[74882]: INFO nova.virt.block_device [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attempting to driver detach volume 26fe9f56-ae93-4cc8-be2d-8a872116ee3b from mountpoint /dev/vdb
Nov 21 15:32:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Attempting to detach device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 15:32:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:32:34 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:32:34 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:32:34 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:32:34 user nova-compute[74882]:   <serial>26fe9f56-ae93-4cc8-be2d-8a872116ee3b</serial>
Nov 21 15:32:34 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:32:34 user nova-compute[74882]: </disk>
Nov 21 15:32:34 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:32:34 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config.
Nov 21 15:32:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 15:32:34 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:32:34 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:32:34 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:32:34 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:32:34 user nova-compute[74882]:   <serial>26fe9f56-ae93-4cc8-be2d-8a872116ee3b</serial>
Nov 21 15:32:34 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:32:34 user nova-compute[74882]: </disk>
Nov 21 15:32:34 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:32:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 15:32:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:32:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:32:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:32:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=24.985530853271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:32:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:32:44 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:48 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:32:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:55 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb is timed out.
Nov 21 15:32:55 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config.
Nov 21 15:32:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwMZDaGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:32:55 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebd5c7-08ba-40db-8998-f9a1869c16be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:32:55 user nova-compute[74882]: No targets found.
Nov 21 15:32:55 user nova-compute[74882]: iSNS:
Nov 21 15:32:55 user nova-compute[74882]: No targets found.
Nov 21 15:32:55 user nova-compute[74882]: STATIC:
Nov 21 15:32:55 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b
Nov 21 15:32:55 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:32:55 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:32:55 user nova-compute[74882]: FIRMWARE:
Nov 21 15:32:55 user nova-compute[74882]: No targets found.
Nov 21 15:32:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:32:55 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:32:55 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[392197b8-1fcc-4ed7-90ff-6c0b2cabfeee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d78cf9-e021-40bd-884a-d7f06ea7bb9e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b (non-flash)
Nov 21 15:32:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b (non-flash)
Nov 21 15:32:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d8c5097e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d3615-3869-4ba2-9d9e-338a45113d65]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[38906b40-4cc2-46e1-a3a3-e6b88ae05bf6]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[44389798-6d07-4ad5-8a87-519ac578000c]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[862b14c6-4e77-41e6-b19d-8b3a38813e16]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[44655185-1ff7-4e8d-b1e8-297467ac4076]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3495d0e6-25e9-4c61-8af5-a0d647a5b25a]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260]
Nov 21 15:32:55 user nova-compute[74882]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b, portal: 172.16.0.220,3260] successful.
Nov 21 15:32:55 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fe9f56-ae93-4cc8-be2d-8a872116ee3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f9024-486b-4548-84b2-932213898554]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== disconnect_volume: return (295ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:32:55 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG nova.objects.instance [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-287fc6ec-c047-4075-a332-cc563738e3fa tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.580s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:32:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:33:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:33:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:33:27 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:33:27 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:33:28 user nova-compute[74882]: INFO nova.compute.manager [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attaching volume 65f23d52-d743-470a-bbf1-4b5e777edd44 to /dev/vdb
Nov 21 15:33:28 user nova-compute[74882]: DEBUG os_brick.utils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e2af79-2dee-448e-83ed-090790bc4967]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c4ccab0d89\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[971d304f-041b-4bbb-b6e6-3aed0b23e1f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a594ab5b-1045-4d68-b3d2-aac136199a81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ffa0bb-11af-44aa-b842-7f0a85eeb4e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Running cmd (subprocess): nvme version {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] 'nvme version' failed. Not Retrying. {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] nvme not present on system {{(pid=74882) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 21 15:33:28 user nova-compute[74882]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 21 15:33:28 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a3c9bd-314c-45a4-ba6f-6c03fd109194]: (4, '') {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74882) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.lightos [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] LIGHTOS: no hostnqn found. {{(pid=74882) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG os_brick.utils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c4ccab0d89', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG nova.virt.block_device [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating existing volume attachment record: d79ab028-5807-46a0-8fdc-05b93a115eb6 {{(pid=74882) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 21 15:33:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:33 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Calling os-brick to attach iSCSI Volume {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 21 15:33:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnxJWTUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:33:33 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:33:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:33:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:33:33 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:33:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:33:33 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:33:33 user nova-compute[74882]: INFO os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 21 15:33:33 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[462395e0-24d3-49ae-96a5-11730c0d6240]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 21 15:33:34 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --interface default --op new {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[98005ebe-3d8a-4912-8dfe-ea429e6e4c6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44] added\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44] added
Nov 21 15:33:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8832c6-646e-4358-95f2-0223344c3944]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ecb5e-8d19-4fd5-ae9b-35a4944f01d8]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnxJWTUN {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnxJWTUN" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68488f8-e27b-4234-afe9-eab842aec203]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RnxJWTUN'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d483075-e3eb-44d9-b619-9dec6a6e82ce]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f52f57d-bd7d-4eea-aa7b-385613039177]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:33:34 user nova-compute[74882]:  {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 21 15:33:34 user nova-compute[74882]:  {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:33:34 user nova-compute[74882]: WARNING os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 21 15:33:34 user nova-compute[74882]: 
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --login {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d71c8d-283a-45c6-bd91-962a5ea7c057]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260]
Nov 21 15:33:34 user nova-compute[74882]: Login to [iface: default, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260] successful.
Nov 21 15:33:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11675b8-1bad-413c-a1ed-17f125ef4085]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d16ceb-ea1d-4200-87d8-3f0a51c9b41a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 (non-flash)
Nov 21 15:33:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 (non-flash)
Nov 21 15:33:34 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to 172.16.0.220:3260 {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74882) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74882) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2f973-1606-4555-804b-df914bbbb3f0]: (4, ('- - 0', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:33:34 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74882) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnxJWTUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74882) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '23333303761663866', 'path': '/dev/sdb'} {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333303761663866', 'path': '/dev/sdb'} {{(pid=74882) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.objects.instance [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] attach device xml: <disk type="block" device="disk">
Nov 21 15:33:35 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:33:35 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:33:35 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:33:35 user nova-compute[74882]:   <serial>65f23d52-d743-470a-bbf1-4b5e777edd44</serial>
Nov 21 15:33:35 user nova-compute[74882]: </disk>
Nov 21 15:33:35 user nova-compute[74882]:  {{(pid=74882) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vda, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74882) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] No VIF found with MAC fa:16:3e:1b:28:c0, not building metadata {{(pid=74882) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 21 15:33:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-7318d2df-b36d-401e-980f-69504d5bdde5 tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.806s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:33:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:33:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:33:38 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:33:38 user nova-compute[74882]: INFO nova.compute.manager [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Detaching volume 65f23d52-d743-470a-bbf1-4b5e777edd44
Nov 21 15:33:38 user nova-compute[74882]: INFO nova.virt.block_device [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Attempting to driver detach volume 65f23d52-d743-470a-bbf1-4b5e777edd44 from mountpoint /dev/vdb
Nov 21 15:33:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Attempting to detach device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config. {{(pid=74882) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 21 15:33:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:33:38 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:33:38 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:33:38 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:33:38 user nova-compute[74882]:   <serial>65f23d52-d743-470a-bbf1-4b5e777edd44</serial>
Nov 21 15:33:38 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:33:38 user nova-compute[74882]: </disk>
Nov 21 15:33:38 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:33:38 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the persistent domain config.
Nov 21 15:33:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config. {{(pid=74882) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 21 15:33:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.guest [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] detach device xml: <disk type="block" device="disk">
Nov 21 15:33:38 user nova-compute[74882]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 21 15:33:38 user nova-compute[74882]:   <source dev="/dev/sdb"/>
Nov 21 15:33:38 user nova-compute[74882]:   <target dev="vdb" bus="virtio"/>
Nov 21 15:33:38 user nova-compute[74882]:   <serial>65f23d52-d743-470a-bbf1-4b5e777edd44</serial>
Nov 21 15:33:38 user nova-compute[74882]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 21 15:33:38 user nova-compute[74882]: </disk>
Nov 21 15:33:38 user nova-compute[74882]:  {{(pid=74882) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 21 15:33:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:38 user nova-compute[74882]: DEBUG nova.virt.libvirt.driver [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 21 15:33:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:42 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:33:43 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:33:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=24.97677230834961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:33:43 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:33:44 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:33:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:33:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:33:56 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:33:58 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb is timed out.
Nov 21 15:33:58 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully detached device vdb from instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb from the live domain config.
Nov 21 15:33:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] calling os-brick to detach iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f6d8c407b80>, {'target_iqn': 'iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnxJWTUN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 21 15:33:58 user nova-compute[74882]: WARNING os_brick.initiator.connectors.base [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf4849-8a15-4410-a3a5-0422c8bb800e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 21 15:33:58 user nova-compute[74882]: No targets found.
Nov 21 15:33:58 user nova-compute[74882]: iSNS:
Nov 21 15:33:58 user nova-compute[74882]: No targets found.
Nov 21 15:33:58 user nova-compute[74882]: STATIC:
Nov 21 15:33:58 user nova-compute[74882]: Target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44
Nov 21 15:33:58 user nova-compute[74882]:         Portal: 172.16.0.220:3260,-1
Nov 21 15:33:58 user nova-compute[74882]:                 Iface Name: default
Nov 21 15:33:58 user nova-compute[74882]: FIRMWARE:
Nov 21 15:33:58 user nova-compute[74882]: No targets found.
Nov 21 15:33:58 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 21 15:33:58 user nova-compute[74882]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 21 15:33:58 user nova-compute[74882]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74882) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44', 0)] {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fcbcf5-3877-4f31-9f5a-7fd5105c48f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fafc9bf-09d4-481f-8686-c363cde8fca6]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 (non-flash)\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 (non-flash)
Nov 21 15:33:58 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 (non-flash)
Nov 21 15:33:58 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f6d6c649e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44'): ({'sdb'}, set())}) {{(pid=74882) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Removing single pathed devices sdb {{(pid=74882) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304c248-2ebd-4b65-a00f-da290f8fda9c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc610e-e108-40af-9829-7205fcc1cce2]: (4, ('ok\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Flushing IO for device /dev/sdb {{(pid=74882) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d841384-2902-436e-bcb7-f2e77ce2a854]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74882) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[8872007b-0542-479b-ab38-65e94961d2ae]: (4, ('1', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.linuxscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] SCSI volumes sdb have been removed. {{(pid=74882) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44')] {{(pid=74882) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe6800-d050-44e8-a959-a9657a80b76b]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --logout {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae3721-48ca-451a-9f75-68e792a42798]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260]
Nov 21 15:33:58 user nova-compute[74882]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44, portal: 172.16.0.220,3260] successful.
Nov 21 15:33:58 user nova-compute[74882]:  stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op delete {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65f23d52-d743-470a-bbf1-4b5e777edd44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85964) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a612fbe-e282-4410-a383-358a44699444]: (4, ('', '')) {{(pid=85964) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74882) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.base [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] <== disconnect_volume: return (293ms) None {{(pid=74882) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 21 15:33:58 user nova-compute[74882]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Disconnected iSCSI Volume {{(pid=74882) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 21 15:33:59 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'flavor' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:33:59 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4e592c69-c8db-46c7-aa06-9d1c19d5c8ce tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:01 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:06 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:11 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:34:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:16 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:34:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:21 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:26 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verify base images {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Image id 56f0cfc7-adc4-437a-accc-8a2f8cd4e785 yields fingerprint aac12dd1600c64b2b2fdf48758857bd03ec9013d {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] image 56f0cfc7-adc4-437a-accc-8a2f8cd4e785 at (/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d): checking
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] image 56f0cfc7-adc4-437a-accc-8a2f8cd4e785 at (/opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d): image is in use {{(pid=74882) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb is a valid instance name {{(pid=74882) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb has a disk file {{(pid=74882) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb is backed by aac12dd1600c64b2b2fdf48758857bd03ec9013d {{(pid=74882) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632
Nov 21 15:34:28 user nova-compute[74882]: WARNING nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Active base files: /opt/stack/data/nova/instances/_base/aac12dd1600c64b2b2fdf48758857bd03ec9013d
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Removable base files: /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876 /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4 /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899 /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9 /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527 /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632 /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/532a1f822805da8cb863779c51f592e723f8c876
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bcd8c990ab9b06064a0a3bdb301a3848340cb70c
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/edd46a4415f4556c8756f41482181fcd314adefc
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d0d4c13b040cef402b5c37a4954edb4c6b017e4
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8394dfd7e80ec0d8e750f57dde0bbd397462a899
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d7459f763ccd8df3f11e91acea1ebbb415fdb2d9
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/de38d66220f6318c8404d57d23e77da464850527
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1b2c6686f7df8ce90b2d04338056e4f7aaa41632
Nov 21 15:34:28 user nova-compute[74882]: INFO nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2902fcb19058ba65ad121ac34b8042865010877e
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verification complete {{(pid=74882) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verify swap images {{(pid=74882) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 21 15:34:28 user nova-compute[74882]: DEBUG nova.virt.libvirt.imagecache [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Verify ephemeral images {{(pid=74882) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 21 15:34:31 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:34 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:34:34 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:34:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 21 15:34:34 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquired lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 21 15:34:34 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Forcefully refreshing network info cache for instance {{(pid=74882) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 21 15:34:34 user nova-compute[74882]: DEBUG nova.objects.instance [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lazy-loading 'info_cache' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:34:35 user nova-compute[74882]: DEBUG nova.network.neutron [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [{"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:34:35 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Releasing lock "refresh_cache-5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" {{(pid=74882) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 21 15:34:35 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updated the network info_cache for instance {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 21 15:34:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:34:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:36 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:38 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:39 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:39 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:34:41 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:34:44 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG oslo_concurrency.processutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74882) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 21 15:34:45 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:34:45 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:34:45 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=8955MB free_disk=24.97594451904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74882) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:34:45 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:46 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:49 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:34:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:34:51 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:34:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:52 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:52 user nova-compute[74882]: INFO nova.compute.manager [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Terminating instance
Nov 21 15:34:52 user nova-compute[74882]: DEBUG nova.compute.manager [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Start destroying the instance on the hypervisor. {{(pid=74882) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 21 15:34:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:52 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-vif-unplugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] No waiting events found dispatching network-vif-unplugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.compute.manager [req-44ca1c1c-c50b-430e-b95c-f129b3c3da26 req-16f8f6a1-bda4-43a4-bd3f-6f90bd186f21 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-vif-unplugged-c7291df2-b001-4983-a875-118cf94bdbd5 for instance with task_state deleting. {{(pid=74882) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [-] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Instance destroyed successfully.
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.objects.instance [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lazy-loading 'resources' on Instance uuid 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb {{(pid=74882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.virt.libvirt.vif [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-21T15:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1145802285',display_name='tempest-SnapshotDataIntegrityTests-server-1145802285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1145802285',id=53,image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1oeHY/5rN1gUrkAKf/4+33RT7/k37VGtmoc5W/wbQ4jyH7nbMrWDqOGR+N2bB54lcmqY01foylD3tqGegEUEJxZhiU4MOwIyw/1hCYuK0+/Hve3EzLI3dEW2K0lYOjw==',key_name='tempest-keypair-1612647852',keypairs=<?>,launch_index=0,launched_at=2023-11-21T15:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='499fb4b9492840f78205dc376e869d28',ramdisk_id='',reservation_id='r-1jefj0ng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56f0cfc7-adc4-437a-accc-8a2f8cd4e785',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1764212604',owner_user_name='tempest-SnapshotDataIntegrityTests-1764212604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-21T15:28:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b231abfef6e430f869eca46aeb5d063',uuid=5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Converting VIF {"id": "c7291df2-b001-4983-a875-118cf94bdbd5", "address": "fa:16:3e:1b:28:c0", "network": {"id": "61623a42-185f-4a0f-ac9c-7d93ceb28acf", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1339328125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "499fb4b9492840f78205dc376e869d28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7291df2-b0", "ovs_interfaceid": "c7291df2-b001-4983-a875-118cf94bdbd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.network.os_vif_util [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=c7291df2-b001-4983-a875-118cf94bdbd5,network=Network(61623a42-185f-4a0f-ac9c-7d93ceb28acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7291df2-b0') {{(pid=74882) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG os_vif [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=c7291df2-b001-4983-a875-118cf94bdbd5,network=Network(61623a42-185f-4a0f-ac9c-7d93ceb28acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7291df2-b0') {{(pid=74882) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7291df2-b0, bridge=br-int, if_exists=True) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3668174-0ffe-4e7f-a1c3-0271abb7e73d) {{(pid=74882) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:34:53 user nova-compute[74882]: INFO os_vif [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=c7291df2-b001-4983-a875-118cf94bdbd5,network=Network(61623a42-185f-4a0f-ac9c-7d93ceb28acf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7291df2-b0')
Nov 21 15:34:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Deleting instance files /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb_del
Nov 21 15:34:53 user nova-compute[74882]: INFO nova.virt.libvirt.driver [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Deletion of /opt/stack/data/nova/instances/5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb_del complete
Nov 21 15:34:53 user nova-compute[74882]: INFO nova.compute.manager [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 21 15:34:53 user nova-compute[74882]: DEBUG oslo.service.loopingcall [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74882) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.compute.manager [-] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Deallocating network for instance {{(pid=74882) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 21 15:34:53 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] deallocate_for_instance() {{(pid=74882) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 21 15:34:54 user nova-compute[74882]: DEBUG nova.network.neutron [-] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Updating instance_info_cache with network_info: [] {{(pid=74882) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 21 15:34:54 user nova-compute[74882]: INFO nova.compute.manager [-] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Took 0.80 seconds to deallocate network for instance.
Nov 21 15:34:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:54 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:34:54 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:34:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:54 user nova-compute[74882]: INFO nova.scheduler.client.report [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Deleted allocations for instance 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb
Nov 21 15:34:54 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-4184e291-3250-4fd4-9f7d-d34b84416c8a tempest-SnapshotDataIntegrityTests-1764212604 tempest-SnapshotDataIntegrityTests-1764212604-project-member] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.015s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:34:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Acquiring lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:34:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:34:55 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] Lock "5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:34:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] No waiting events found dispatching network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 21 15:34:55 user nova-compute[74882]: WARNING nova.compute.manager [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received unexpected event network-vif-plugged-c7291df2-b001-4983-a875-118cf94bdbd5 for instance with vm_state deleted and task_state None.
Nov 21 15:34:55 user nova-compute[74882]: DEBUG nova.compute.manager [req-3a904daa-6bcf-4b59-9657-aebf5fce65fc req-e9f47c1c-5e25-45ad-bffa-17d437eee6e1 service nova] [instance: 5d9b0902-3dca-4f4d-b7bf-7b7a26cd4afb] Received event network-vif-deleted-c7291df2-b001-4983-a875-118cf94bdbd5 {{(pid=74882) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 21 15:34:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:01 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:35:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:05 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 21 15:35:05 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] There are 0 instances to clean {{(pid=74882) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 21 15:35:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:20 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:20 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74882) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 21 15:35:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:35:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:35:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:35:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:36 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:35:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:35:36 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:35:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:40 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:40 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:35:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:35:44 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:45 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:46 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:35:46 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:35:46 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:35:46 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9083MB free_disk=25.00287628173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:35:46 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing inventories for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating ProviderTree inventory for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Updating inventory in ProviderTree for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing aggregate associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, aggregates: None {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Refreshing trait associations for resource provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_TRUSTED_CERTS,COMPUTE_NODE {{(pid=74882) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:35:47 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:35:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:50 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:53 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:35:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:35:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:36:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:36:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:36:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:36:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:36:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:36:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:36:28 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:33 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:36:37 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Starting heal instance info cache {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 21 15:36:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Rebuilding the list of instances to heal {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 21 15:36:37 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Didn't find any instances for network info cache update. {{(pid=74882) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 21 15:36:38 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:41 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:41 user nova-compute[74882]: DEBUG nova.compute.manager [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74882) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 21 15:36:42 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:43 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:43 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:36:47 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Auditing locally available compute resources for user (node: user) {{(pid=74882) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:36:48 user nova-compute[74882]: WARNING nova.virt.libvirt.driver [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 21 15:36:48 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Hypervisor/Node resource view: name=user free_ram=9213MB free_disk=24.995208740234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74882) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 21 15:36:48 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 21 15:36:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 21 15:36:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74882) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 21 15:36:49 user nova-compute[74882]: DEBUG nova.compute.provider_tree [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed in ProviderTree for provider: f2c18da1-f4fd-49b6-a78a-043389a6ebfc {{(pid=74882) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 21 15:36:49 user nova-compute[74882]: DEBUG nova.scheduler.client.report [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Inventory has not changed for provider f2c18da1-f4fd-49b6-a78a-043389a6ebfc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74882) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 21 15:36:49 user nova-compute[74882]: DEBUG nova.compute.resource_tracker [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Compute_service record updated for user:user {{(pid=74882) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 21 15:36:49 user nova-compute[74882]: DEBUG oslo_concurrency.lockutils [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=74882) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 21 15:36:51 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:36:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:36:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:36:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:36:53 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:36:55 user nova-compute[74882]: DEBUG oslo_service.periodic_task [None req-b4805187-6de5-464b-8058-f51ad8031c75 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74882) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 21 15:36:58 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:37:03 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:37:08 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:37:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 21 15:37:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:37:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74882) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 21 15:37:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:37:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74882) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 21 15:37:13 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:37:18 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 21 15:37:23 user nova-compute[74882]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74882) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}